Java Programming for Tensor Flow Object Detection : Question

[FTC0265]

Last year there was a sample program in Java (in FTC Appmaster external samples) which used the Tensor Flow Object Detection to decide where the gold block was for last year's game. It reported "left", "right" or "center". Is there a similar Java code for this year's game?

[mikets]

Yes, FTC SDK has a sample for TensorFlow called ConceptTensorFlowObjectDetection.java.
https://github.com/trc492/FtcSamples...Detection.java
It will tell you what it detected and the detected objects' rectangle.

[Lunerwalker2]

That code was a VuMark ID code, not tensor flow. Concept vumark identification is what it is, and you can change things for skystone use.

[Tom Eng]

That code was a VuMark ID code, not tensor flow. Concept vumark identification is what it is, and you can change things for skystone use.

Hi Lunerwalker2

I believe the VuMark ID sample op modes that are included are relevant to the VuMarks used in the Relic Recovery season. They would not apply to the Skystone game since there aren't any VuMarks included in this year's game.

For the Skystone season, if you'd like to see how to use the TensorFlow Lite inference model to identify and track Stones and Skystones, the ConceptTensorFlowObjectDetection sample op mode that mikets referred to is the correct one to examine.

If you want to learn how to use the Vuforia image targets (which are a little different from a VuMark) then the ConceptVuforiaSkyStoneNavigation sample op mode is the sample that you will want to examine.

[Lunerwalker2]

Hi Lunerwalker2

I believe the VuMark ID sample op modes that are included are relevant to the VuMarks used in the Relic Recovery season. They would not apply to the Skystone game since there aren't any VuMarks included in this year's game.

For the Skystone season, if you'd like to see how to use the TensorFlow Lite inference model to identify and track Stones and Skystones, the ConceptTensorFlowObjectDetection sample op mode that mikets referred to is the correct one to examine.

If you want to learn how to use the Vuforia image targets (which are a little different from a VuMark) then the ConceptVuforiaSkyStoneNavigation sample op mode is the sample that you will want to examine.

While that is true, and the Vumark ID sample code found in the ftc library is for relic recovery, it is not unusable. Vuforia is used just the same in that code, but the image trackables loaded are for relic recovery. In the Skystone/FtcRobotController/sec/main/assets, the image trackables for Vuforia are listed. As you can see, there are files for both RelicRecovery and for Skystone. The first trackable in the list for Skystone.xml is the Skystone vumark. If you go back to the VuMarkIdentification sample code, where it says

VuforiaTrackables relicTrackables = this.vuforia.loadTrackablesFromAsset("RelicRecovery")

you can change "RelicRecovery" to "Skystone". This will load the Skystone trackables instead of RelicRecovery ones. Likewise, you can leave this, because the Skystone trackable is the first in the list.

VuforiaTrackable skystoneStone = skystoneTrackables.get(0);

And yes, there are vumarks in this year's game. Each picture on the wall is a vumark, as well as the Skystone and the bridge pictures, and that's also how all the other Vuforia concepts work. (They just use other things in order to localize. They left this in because it's very simple to see how Vuforia works here.)

[Lunerwalker2]

Just reread the message, and I understand what you are saying. Ignore the previous message.