[User] <image> Find the "sperm".

[Assistant]
```json
[{"point_2d": [103.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [422.0, 180.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [603.0, 106.5], "label": "sperm"}, {"point_2d": [577.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [259.0, 462.5], "label": "sperm"}, {"point_2d": [138.0, 269.0], "label": "sperm"}, {"point_2d": [150.0, 456.0], "label": "sperm"}, {"point_2d": [440.0, 355.0], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Generate bounding box coordinates for the normal sperm.

[Assistant]
```json
[{"bbox_2d": [94.0, 170.0, 112.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [408.0, 166.0, 436.0, 194.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [591.0, 92.0, 615.0, 121.0], "label": "normal sperm"}, {"bbox_2d": [559.0, 339.0, 595.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [248.0, 452.0, 270.0, 473.0], "label": "normal sperm"}, {"bbox_2d": [119.0, 253.0, 157.0, 285.0], "label": "normal sperm"}, {"bbox_2d": [136.0, 444.0, 164.0, 468.0], "label": "normal sperm"}, {"bbox_2d": [426.0, 342.0, 454.0, 368.0], "label": "normal sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "normal sperm"}]
```


[User] <image> How many sperm are there?

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> Show me each sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 16, "point_2d": [[103.0, 180.0], [327.5, 91.0], [422.0, 180.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [603.0, 106.5], [577.0, 354.5], [366.0, 431.0], [259.0, 462.5], [138.0, 269.0], [150.0, 456.0], [440.0, 355.0], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Output the total count of sperm in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 16, "bbox_2d": [[94.0, 170.0, 112.0, 190.0], [315.0, 80.0, 340.0, 102.0], [408.0, 166.0, 436.0, 194.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [591.0, 92.0, 615.0, 121.0], [559.0, 339.0, 595.0, 370.0], [358.0, 423.0, 374.0, 439.0], [248.0, 452.0, 270.0, 473.0], [119.0, 253.0, 157.0, 285.0], [136.0, 444.0, 164.0, 468.0], [426.0, 342.0, 454.0, 368.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Locate every sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Outline the cluster using a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> In all the picture, how many sperm cluster are there?

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Locate the sperm cluster and count them, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Detect all sperm cluster in the image with bounding boxes, and then output their count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> If there are any sperms in the image, show me where they are.

[Assistant]
```json
[{"point_2d": [103.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [421.0, 180.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [603.0, 106.5], "label": "sperm"}, {"point_2d": [577.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [260.0, 462.5], "label": "sperm"}, {"point_2d": [144.0, 266.0], "label": "sperm"}, {"point_2d": [148.0, 457.0], "label": "sperm"}, {"point_2d": [449.0, 347.5], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Mark the object sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [94.0, 170.0, 112.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [407.0, 166.0, 435.0, 194.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [591.0, 92.0, 615.0, 121.0], "label": "sperm"}, {"bbox_2d": [559.0, 339.0, 595.0, 370.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [249.0, 452.0, 271.0, 473.0], "label": "sperm"}, {"bbox_2d": [125.0, 250.0, 163.0, 282.0], "label": "sperm"}, {"bbox_2d": [134.0, 445.0, 162.0, 469.0], "label": "sperm"}, {"bbox_2d": [435.0, 334.0, 463.0, 361.0], "label": "sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "sperm"}]
```


[User] <image> How many sperm.

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> Find all the normal sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 16, "point_2d": [[103.0, 180.0], [327.5, 91.0], [421.0, 180.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [603.0, 106.5], [577.0, 354.5], [366.0, 431.0], [260.0, 462.5], [144.0, 266.0], [148.0, 457.0], [449.0, 347.5], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Outline all instances of normal sperm with bounding boxes, then return the count.

[Assistant]
```json
{"count": 16, "bbox_2d": [[94.0, 170.0, 112.0, 190.0], [315.0, 80.0, 340.0, 102.0], [407.0, 166.0, 435.0, 194.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [591.0, 92.0, 615.0, 121.0], [559.0, 339.0, 595.0, 370.0], [358.0, 423.0, 374.0, 439.0], [249.0, 452.0, 271.0, 473.0], [125.0, 250.0, 163.0, 282.0], [134.0, 445.0, 162.0, 469.0], [435.0, 334.0, 463.0, 361.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Return a bounding box that encloses sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Point to all occurrences of "sperm cluster" and output the total count.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Count every cluster in the picture, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Draw bounding boxes around every cluster and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Show me where a sperm is

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [424.0, 182.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [602.0, 103.5], "label": "sperm"}, {"point_2d": [576.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [258.0, 459.5], "label": "sperm"}, {"point_2d": [122.5, 270.0], "label": "sperm"}, {"point_2d": [427.0, 344.0], "label": "sperm"}, {"point_2d": [606.0, 466.0], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Generate bounding box coordinates for the sperm.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [410.0, 168.0, 438.0, 196.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [590.0, 89.0, 614.0, 118.0], "label": "sperm"}, {"bbox_2d": [558.0, 339.0, 594.0, 370.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [247.0, 449.0, 269.0, 470.0], "label": "sperm"}, {"bbox_2d": [109.0, 256.0, 136.0, 284.0], "label": "sperm"}, {"bbox_2d": [413.0, 331.0, 441.0, 357.0], "label": "sperm"}, {"bbox_2d": [594.0, 456.0, 618.0, 476.0], "label": "sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "sperm"}]
```


[User] <image> Locate the sperm and count them

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> How many sperm are there? Point to them.

[Assistant]
```json
{"count": 16, "point_2d": [[102.0, 180.0], [327.5, 91.0], [424.0, 182.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [602.0, 103.5], [576.0, 354.5], [366.0, 431.0], [258.0, 459.5], [122.5, 270.0], [427.0, 344.0], [606.0, 466.0], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Output the total count of sperm in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 16, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [410.0, 168.0, 438.0, 196.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [590.0, 89.0, 614.0, 118.0], [558.0, 339.0, 594.0, 370.0], [358.0, 423.0, 374.0, 439.0], [247.0, 449.0, 269.0, 470.0], [109.0, 256.0, 136.0, 284.0], [413.0, 331.0, 441.0, 357.0], [594.0, 456.0, 618.0, 476.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Find the "cluster".

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Return the bounding box of the cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Generate list of points showing where the sperm cluster are and output the total count.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Count the sperm cluster in the image, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Return bounding boxes for each sperm cluster in the image and the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> show me all visible normal sperms

[Assistant]
```json
[{"point_2d": [101.0, 180.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [430.0, 186.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 274.0], "label": "normal sperm"}, {"point_2d": [471.5, 258.0], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 99.5], "label": "normal sperm"}, {"point_2d": [575.0, 354.5], "label": "normal sperm"}, {"point_2d": [366.0, 431.0], "label": "normal sperm"}, {"point_2d": [257.0, 455.5], "label": "normal sperm"}, {"point_2d": [104.0, 255.0], "label": "normal sperm"}, {"point_2d": [390.0, 328.5], "label": "normal sperm"}, {"point_2d": [164.0, 473.0], "label": "normal sperm"}, {"point_2d": [45.0, 154.5], "label": "normal sperm"}]
```


[User] <image> Find the sperm in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [92.0, 170.0, 110.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [416.0, 172.0, 444.0, 200.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 85.0, 613.0, 114.0], "label": "sperm"}, {"bbox_2d": [557.0, 339.0, 593.0, 370.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [246.0, 445.0, 268.0, 466.0], "label": "sperm"}, {"bbox_2d": [91.0, 241.0, 117.0, 269.0], "label": "sperm"}, {"bbox_2d": [376.0, 315.0, 404.0, 342.0], "label": "sperm"}, {"bbox_2d": [158.0, 466.0, 170.0, 480.0], "label": "sperm"}, {"bbox_2d": [33.0, 144.0, 57.0, 165.0], "label": "sperm"}]
```


[User] <image> Point to every sperm

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> Count every normal sperm in the picture, then point to them.

[Assistant]
```json
{"count": 16, "point_2d": [[101.0, 180.0], [327.5, 91.0], [430.0, 186.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [601.0, 99.5], [575.0, 354.5], [366.0, 431.0], [257.0, 455.5], [104.0, 255.0], [390.0, 328.5], [164.0, 473.0], [45.0, 154.5]], "label": "sperm"}
```


[User] <image> Locate all instances of normal sperm, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 16, "bbox_2d": [[92.0, 170.0, 110.0, 190.0], [315.0, 80.0, 340.0, 102.0], [416.0, 172.0, 444.0, 200.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 85.0, 613.0, 114.0], [557.0, 339.0, 593.0, 370.0], [358.0, 423.0, 374.0, 439.0], [246.0, 445.0, 268.0, 466.0], [91.0, 241.0, 117.0, 269.0], [376.0, 315.0, 404.0, 342.0], [158.0, 466.0, 170.0, 480.0], [33.0, 144.0, 57.0, 165.0]], "label": "sperm"}
```


[User] <image> Show me where the clusters are

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Enclose sperm cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Tell me where each cluster is.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> How many sperm cluster are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Mark all sperm cluster with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Locate the sperm.

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [429.0, 185.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 100.5], "label": "sperm"}, {"point_2d": [575.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [256.0, 455.5], "label": "sperm"}, {"point_2d": [107.5, 257.0], "label": "sperm"}, {"point_2d": [397.5, 333.5], "label": "sperm"}, {"point_2d": [159.0, 472.0], "label": "sperm"}, {"point_2d": [45.0, 154.5], "label": "sperm"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [415.0, 171.0, 443.0, 199.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 86.0, 613.0, 115.0], "label": "sperm"}, {"bbox_2d": [557.0, 339.0, 593.0, 370.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [245.0, 445.0, 267.0, 466.0], "label": "sperm"}, {"bbox_2d": [94.0, 243.0, 121.0, 271.0], "label": "sperm"}, {"bbox_2d": [384.0, 320.0, 411.0, 347.0], "label": "sperm"}, {"bbox_2d": [153.0, 465.0, 165.0, 479.0], "label": "sperm"}, {"bbox_2d": [33.0, 144.0, 57.0, 165.0], "label": "sperm"}]
```


[User] <image> find any sperm in the picture and output the total count.

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> Count the sperm in the image, then point to them.

[Assistant]
```json
{"count": 16, "point_2d": [[102.0, 180.0], [327.5, 91.0], [429.0, 185.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [601.0, 100.5], [575.0, 354.5], [366.0, 431.0], [256.0, 455.5], [107.5, 257.0], [397.5, 333.5], [159.0, 472.0], [45.0, 154.5]], "label": "sperm"}
```


[User] <image> Draw bounding boxes around every sperm and then provide the total count.

[Assistant]
```json
{"count": 16, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [415.0, 171.0, 443.0, 199.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 86.0, 613.0, 115.0], [557.0, 339.0, 593.0, 370.0], [358.0, 423.0, 374.0, 439.0], [245.0, 445.0, 267.0, 466.0], [94.0, 243.0, 121.0, 271.0], [384.0, 320.0, 411.0, 347.0], [153.0, 465.0, 165.0, 479.0], [33.0, 144.0, 57.0, 165.0]], "label": "sperm"}
```


[User] <image> If there are any sperm clusters present, indicate their positions.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> If there are any cluster present, indicate their positions and output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Show me each sperm cluster by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Output a list of bounding boxes for every sperm cluster and the overall count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> If there are any sperms in the image, show me where they are.

[Assistant]
```json
[{"point_2d": [103.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [419.0, 177.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [472.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [603.0, 107.5], "label": "sperm"}, {"point_2d": [577.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [260.0, 463.5], "label": "sperm"}, {"point_2d": [147.0, 269.0], "label": "sperm"}, {"point_2d": [145.0, 458.0], "label": "sperm"}, {"point_2d": [457.5, 353.5], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Outline the area containing normal sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [94.0, 170.0, 112.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [405.0, 163.0, 433.0, 191.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [462.0, 247.0, 483.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [591.0, 93.0, 615.0, 122.0], "label": "normal sperm"}, {"bbox_2d": [559.0, 339.0, 595.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [249.0, 453.0, 271.0, 474.0], "label": "normal sperm"}, {"bbox_2d": [128.0, 253.0, 166.0, 285.0], "label": "normal sperm"}, {"bbox_2d": [131.0, 446.0, 159.0, 470.0], "label": "normal sperm"}, {"bbox_2d": [444.0, 340.0, 471.0, 367.0], "label": "normal sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "normal sperm"}]
```


[User] <image> Give me the count of sperm in the image.

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> Show me each normal sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 16, "point_2d": [[103.0, 180.0], [327.5, 91.0], [419.0, 177.0], [16.0, 180.0], [169.5, 274.0], [472.5, 258.0], [278.0, 458.5], [181.0, 401.0], [603.0, 107.5], [577.0, 354.5], [366.0, 431.0], [260.0, 463.5], [147.0, 269.0], [145.0, 458.0], [457.5, 353.5], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Count every normal sperm and return a list of bounding boxes.

[Assistant]
```json
{"count": 16, "bbox_2d": [[94.0, 170.0, 112.0, 190.0], [315.0, 80.0, 340.0, 102.0], [405.0, 163.0, 433.0, 191.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [462.0, 247.0, 483.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [591.0, 93.0, 615.0, 122.0], [559.0, 339.0, 595.0, 370.0], [358.0, 423.0, 374.0, 439.0], [249.0, 453.0, 271.0, 474.0], [128.0, 253.0, 166.0, 285.0], [131.0, 446.0, 159.0, 470.0], [444.0, 340.0, 471.0, 367.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Locate all clusters.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Outline the area containing sperm cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> How many cluster.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Locate all sperm cluster in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Provide bounding box coordinates for each sperm cluster and then specify the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Point to every normal sperm

[Assistant]
```json
[{"point_2d": [103.0, 180.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [421.0, 180.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 274.0], "label": "normal sperm"}, {"point_2d": [471.5, 258.0], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [603.0, 106.5], "label": "normal sperm"}, {"point_2d": [577.0, 354.5], "label": "normal sperm"}, {"point_2d": [366.0, 431.0], "label": "normal sperm"}, {"point_2d": [259.0, 462.5], "label": "normal sperm"}, {"point_2d": [140.0, 268.0], "label": "normal sperm"}, {"point_2d": [150.0, 456.5], "label": "normal sperm"}, {"point_2d": [444.0, 354.5], "label": "normal sperm"}, {"point_2d": [46.0, 153.5], "label": "normal sperm"}]
```


[User] <image> Mark the object normal sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [94.0, 170.0, 112.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [407.0, 166.0, 435.0, 194.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [591.0, 92.0, 615.0, 121.0], "label": "normal sperm"}, {"bbox_2d": [559.0, 339.0, 595.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [248.0, 452.0, 270.0, 473.0], "label": "normal sperm"}, {"bbox_2d": [121.0, 252.0, 159.0, 284.0], "label": "normal sperm"}, {"bbox_2d": [136.0, 444.0, 164.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [430.0, 341.0, 458.0, 368.0], "label": "normal sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "normal sperm"}]
```


[User] <image> Are there any normal sperm in the image? How many are there?

[Assistant]
```json
{"count": 16, "label": "normal sperm"}
```


[User] <image> Identify all occurrences of normal sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 16, "point_2d": [[103.0, 180.0], [327.5, 91.0], [421.0, 180.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [603.0, 106.5], [577.0, 354.5], [366.0, 431.0], [259.0, 462.5], [140.0, 268.0], [150.0, 456.5], [444.0, 354.5], [46.0, 153.5]], "label": "normal sperm"}
```


[User] <image> Output the total count of normal sperm in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 16, "bbox_2d": [[94.0, 170.0, 112.0, 190.0], [315.0, 80.0, 340.0, 102.0], [407.0, 166.0, 435.0, 194.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [591.0, 92.0, 615.0, 121.0], [559.0, 339.0, 595.0, 370.0], [358.0, 423.0, 374.0, 439.0], [248.0, 452.0, 270.0, 473.0], [121.0, 252.0, 159.0, 284.0], [136.0, 444.0, 164.0, 469.0], [430.0, 341.0, 458.0, 368.0], [34.0, 143.0, 58.0, 164.0]], "label": "normal sperm"}
```


[User] <image> Find the cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Count every cluster in the picture.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Locate the sperm cluster and count them, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Count all sperm cluster in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User]
<image> Help me find an object in the image by pointing to it.
Object: sperm.

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [425.0, 183.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [602.0, 103.5], "label": "sperm"}, {"point_2d": [576.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [257.0, 458.5], "label": "sperm"}, {"point_2d": [118.5, 266.0], "label": "sperm"}, {"point_2d": [422.0, 345.5], "label": "sperm"}, {"point_2d": [625.0, 469.5], "label": "sperm"}, {"point_2d": [150.0, 475.5], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Draw a bounding box around normal sperm.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [411.0, 169.0, 439.0, 197.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [590.0, 89.0, 614.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [558.0, 339.0, 594.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [246.0, 448.0, 268.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [105.0, 252.0, 132.0, 280.0], "label": "normal sperm"}, {"bbox_2d": [408.0, 332.0, 436.0, 359.0], "label": "normal sperm"}, {"bbox_2d": [613.0, 459.0, 637.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 471.0, 156.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "normal sperm"}]
```


[User] <image> Point to and count the sperm in the picture.

[Assistant]
```json
{"count": 17, "label": "sperm"}
```


[User] <image> Find each sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 17, "point_2d": [[102.0, 180.0], [327.5, 91.0], [425.0, 183.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [602.0, 103.5], [576.0, 354.5], [366.0, 431.0], [257.0, 458.5], [118.5, 266.0], [422.0, 345.5], [625.0, 469.5], [150.0, 475.5], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Identify each sperm by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 17, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [411.0, 169.0, 439.0, 197.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [590.0, 89.0, 614.0, 118.0], [558.0, 339.0, 594.0, 370.0], [358.0, 423.0, 374.0, 439.0], [246.0, 448.0, 268.0, 469.0], [105.0, 252.0, 132.0, 280.0], [408.0, 332.0, 436.0, 359.0], [613.0, 459.0, 637.0, 480.0], [144.0, 471.0, 156.0, 480.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Locate a cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> How many cluster are there in the image?

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Find all the cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Provide the total number of cluster and for each, supply a bounding box.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Point out every sperm in the image.

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [429.0, 185.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 100.5], "label": "sperm"}, {"point_2d": [575.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [256.0, 455.5], "label": "sperm"}, {"point_2d": [106.5, 256.0], "label": "sperm"}, {"point_2d": [396.0, 331.5], "label": "sperm"}, {"point_2d": [156.5, 472.0], "label": "sperm"}, {"point_2d": [45.0, 154.5], "label": "sperm"}]
```


[User] <image> Identify sperm and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [415.0, 171.0, 443.0, 199.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 86.0, 613.0, 115.0], "label": "sperm"}, {"bbox_2d": [557.0, 339.0, 593.0, 370.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [245.0, 445.0, 267.0, 466.0], "label": "sperm"}, {"bbox_2d": [93.0, 242.0, 120.0, 270.0], "label": "sperm"}, {"bbox_2d": [382.0, 318.0, 410.0, 345.0], "label": "sperm"}, {"bbox_2d": [150.0, 465.0, 163.0, 479.0], "label": "sperm"}, {"bbox_2d": [33.0, 144.0, 57.0, 165.0], "label": "sperm"}]
```


[User] <image> Where are the normal sperm? How many are there?

[Assistant]
```json
{"count": 16, "label": "normal sperm"}
```


[User] <image> Find all the sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 16, "point_2d": [[102.0, 180.0], [327.5, 91.0], [429.0, 185.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [601.0, 100.5], [575.0, 354.5], [366.0, 431.0], [256.0, 455.5], [106.5, 256.0], [396.0, 331.5], [156.5, 472.0], [45.0, 154.5]], "label": "normal sperm"}
```


[User] <image> Return bounding boxes for each sperm in the image and the total count.

[Assistant]
```json
{"count": 16, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [415.0, 171.0, 443.0, 199.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 86.0, 613.0, 115.0], [557.0, 339.0, 593.0, 370.0], [358.0, 423.0, 374.0, 439.0], [245.0, 445.0, 267.0, 466.0], [93.0, 242.0, 120.0, 270.0], [382.0, 318.0, 410.0, 345.0], [150.0, 465.0, 163.0, 479.0], [33.0, 144.0, 57.0, 165.0]], "label": "normal sperm"}
```


[User] <image> Point to any sperm clusters in the image

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Identify cluster and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> find any cluster in the picture and output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Find each sperm cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Draw bounding boxes around every sperm cluster and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Look for sperms in the image and show me where they are.

[Assistant]
```json
[{"point_2d": [103.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [420.0, 178.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [472.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [603.0, 107.5], "label": "sperm"}, {"point_2d": [577.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [260.0, 463.5], "label": "sperm"}, {"point_2d": [146.0, 267.0], "label": "sperm"}, {"point_2d": [146.0, 458.0], "label": "sperm"}, {"point_2d": [453.0, 344.0], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Detect the normal sperm and enclose it in a bounding box with coordinates.

[Assistant]
```json
[{"bbox_2d": [94.0, 170.0, 112.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [406.0, 164.0, 434.0, 192.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [462.0, 247.0, 483.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [591.0, 93.0, 615.0, 122.0], "label": "normal sperm"}, {"bbox_2d": [559.0, 339.0, 595.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [249.0, 453.0, 271.0, 474.0], "label": "normal sperm"}, {"bbox_2d": [127.0, 251.0, 165.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [132.0, 446.0, 160.0, 470.0], "label": "normal sperm"}, {"bbox_2d": [439.0, 331.0, 467.0, 357.0], "label": "normal sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "normal sperm"}]
```


[User] <image> If you see any sperm in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 16, "label": "sperm"}
```


[User] <image> Indicate each normal sperm in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 16, "point_2d": [[103.0, 180.0], [327.5, 91.0], [420.0, 178.0], [16.0, 180.0], [169.5, 274.0], [472.5, 258.0], [278.0, 458.5], [181.0, 401.0], [603.0, 107.5], [577.0, 354.5], [366.0, 431.0], [260.0, 463.5], [146.0, 267.0], [146.0, 458.0], [453.0, 344.0], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Outline all instances of normal sperm with bounding boxes, then return the count.

[Assistant]
```json
{"count": 16, "bbox_2d": [[94.0, 170.0, 112.0, 190.0], [315.0, 80.0, 340.0, 102.0], [406.0, 164.0, 434.0, 192.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [462.0, 247.0, 483.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [591.0, 93.0, 615.0, 122.0], [559.0, 339.0, 595.0, 370.0], [358.0, 423.0, 374.0, 439.0], [249.0, 453.0, 271.0, 474.0], [127.0, 251.0, 165.0, 283.0], [132.0, 446.0, 160.0, 470.0], [439.0, 331.0, 467.0, 357.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Locate each sperm cluster in the image.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Generate bounding box coordinates for the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> count each cluster

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Count every cluster in the picture, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Return both the count and the bounding boxes of all cluster in the image.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User]
<image> Object: sperm
Instruction: Point to the object.

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [426.0, 183.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [602.0, 102.5], "label": "sperm"}, {"point_2d": [576.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [257.0, 457.5], "label": "sperm"}, {"point_2d": [115.5, 263.0], "label": "sperm"}, {"point_2d": [414.0, 341.5], "label": "sperm"}, {"point_2d": [628.0, 453.0], "label": "sperm"}, {"point_2d": [149.0, 475.5], "label": "sperm"}, {"point_2d": [45.5, 154.5], "label": "sperm"}]
```


[User] <image> Outline the area containing normal sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [412.0, 169.0, 440.0, 197.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [590.0, 88.0, 614.0, 117.0], "label": "normal sperm"}, {"bbox_2d": [558.0, 339.0, 594.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [246.0, 447.0, 268.0, 468.0], "label": "normal sperm"}, {"bbox_2d": [102.0, 249.0, 129.0, 277.0], "label": "normal sperm"}, {"bbox_2d": [400.0, 328.0, 428.0, 355.0], "label": "normal sperm"}, {"bbox_2d": [616.0, 443.0, 640.0, 463.0], "label": "normal sperm"}, {"bbox_2d": [143.0, 471.0, 155.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [33.0, 144.0, 58.0, 165.0], "label": "normal sperm"}]
```


[User] <image> find any sperm in the picture and output the total count.

[Assistant]
```json
{"count": 17, "label": "sperm"}
```


[User] <image> Count the sperm in the image, then point to them.

[Assistant]
```json
{"count": 17, "point_2d": [[102.0, 180.0], [327.5, 91.0], [426.0, 183.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [602.0, 102.5], [576.0, 354.5], [366.0, 431.0], [257.0, 457.5], [115.5, 263.0], [414.0, 341.5], [628.0, 453.0], [149.0, 475.5], [45.5, 154.5]], "label": "sperm"}
```


[User] <image> Count every sperm and return a list of bounding boxes.

[Assistant]
```json
{"count": 17, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [412.0, 169.0, 440.0, 197.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [590.0, 88.0, 614.0, 117.0], [558.0, 339.0, 594.0, 370.0], [358.0, 423.0, 374.0, 439.0], [246.0, 447.0, 268.0, 468.0], [102.0, 249.0, 129.0, 277.0], [400.0, 328.0, 428.0, 355.0], [616.0, 443.0, 640.0, 463.0], [143.0, 471.0, 155.0, 480.0], [33.0, 144.0, 58.0, 165.0]], "label": "sperm"}
```


[User] <image> Generate a list of points showing where the clusters are.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Mark the cluster with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Locate the sperm cluster and count them

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Count every sperm cluster in the picture, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Return bounding boxes for each sperm cluster in the image and the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Show me where a sperm is.

[Assistant]
```json
[{"point_2d": [90.0, 179.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [486.0, 278.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.5], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [13.5, 63.0], "label": "sperm"}, {"point_2d": [292.0, 434.0], "label": "sperm"}, {"point_2d": [264.0, 388.5], "label": "sperm"}, {"point_2d": [530.0, 188.5], "label": "sperm"}, {"point_2d": [487.5, 285.5], "label": "sperm"}, {"point_2d": [580.5, 238.5], "label": "sperm"}, {"point_2d": [35.0, 163.5], "label": "sperm"}]
```


[User] <image> Return the bounding box of the sperm.

[Assistant]
```json
[{"bbox_2d": [81.0, 169.0, 99.0, 189.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [472.0, 264.0, 500.0, 292.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 284.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [0.0, 49.0, 27.0, 77.0], "label": "sperm"}, {"bbox_2d": [280.0, 422.0, 304.0, 446.0], "label": "sperm"}, {"bbox_2d": [250.0, 376.0, 278.0, 401.0], "label": "sperm"}, {"bbox_2d": [518.0, 176.0, 542.0, 201.0], "label": "sperm"}, {"bbox_2d": [474.0, 273.0, 501.0, 298.0], "label": "sperm"}, {"bbox_2d": [568.0, 225.0, 593.0, 252.0], "label": "sperm"}, {"bbox_2d": [23.0, 153.0, 47.0, 174.0], "label": "sperm"}]
```


[User] <image> Locate all sperm in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 19, "point_2d": [[90.0, 179.0], [327.5, 91.0], [486.0, 278.0], [16.0, 180.0], [169.5, 275.5], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [13.5, 63.0], [292.0, 434.0], [264.0, 388.5], [530.0, 188.5], [487.5, 285.5], [580.5, 238.5], [35.0, 163.5]], "label": "normal sperm"}
```


[User] <image> Locate all instances of sperm, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 19, "bbox_2d": [[81.0, 169.0, 99.0, 189.0], [315.0, 80.0, 340.0, 102.0], [472.0, 264.0, 500.0, 292.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 284.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [0.0, 49.0, 27.0, 77.0], [280.0, 422.0, 304.0, 446.0], [250.0, 376.0, 278.0, 401.0], [518.0, 176.0, 542.0, 201.0], [474.0, 273.0, 501.0, 298.0], [568.0, 225.0, 593.0, 252.0], [23.0, 153.0, 47.0, 174.0]], "label": "normal sperm"}
```


[User] <image> Point to a sperm cluster

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Locate and mark sperm cluster with a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Give me the count of sperm cluster in the image.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Mark all visible cluster in the image with a point and then provide the count.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Identify all cluster in the image, count them, and provide bounding box coordinates for each.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> If there are any normal sperms in the image, show me where they are.

[Assistant]
```json
[{"point_2d": [101.0, 180.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [431.0, 187.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 274.0], "label": "normal sperm"}, {"point_2d": [471.5, 258.0], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [574.0, 355.5], "label": "normal sperm"}, {"point_2d": [366.0, 431.0], "label": "normal sperm"}, {"point_2d": [258.0, 454.5], "label": "normal sperm"}, {"point_2d": [98.5, 253.0], "label": "normal sperm"}, {"point_2d": [373.0, 333.5], "label": "normal sperm"}, {"point_2d": [230.5, 462.0], "label": "normal sperm"}, {"point_2d": [165.0, 472.0], "label": "normal sperm"}, {"point_2d": [44.0, 154.5], "label": "normal sperm"}]
```


[User] <image> Detect the normal sperm and enclose it in a bounding box with coordinates.

[Assistant]
```json
[{"bbox_2d": [92.0, 170.0, 110.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [417.0, 173.0, 445.0, 201.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [556.0, 340.0, 592.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [247.0, 444.0, 269.0, 465.0], "label": "normal sperm"}, {"bbox_2d": [85.0, 239.0, 112.0, 267.0], "label": "normal sperm"}, {"bbox_2d": [359.0, 320.0, 387.0, 347.0], "label": "normal sperm"}, {"bbox_2d": [218.0, 451.0, 243.0, 473.0], "label": "normal sperm"}, {"bbox_2d": [156.0, 465.0, 174.0, 479.0], "label": "normal sperm"}, {"bbox_2d": [32.0, 144.0, 56.0, 165.0], "label": "normal sperm"}]
```


[User] <image> How many sperm are there in the image?

[Assistant]
```json
{"count": 17, "label": "sperm"}
```


[User] <image> Indicate each normal sperm in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 17, "point_2d": [[101.0, 180.0], [327.5, 91.0], [431.0, 187.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [574.0, 355.5], [366.0, 431.0], [258.0, 454.5], [98.5, 253.0], [373.0, 333.5], [230.5, 462.0], [165.0, 472.0], [44.0, 154.5]], "label": "sperm"}
```


[User] <image> Count every normal sperm and return a list of bounding boxes.

[Assistant]
```json
{"count": 17, "bbox_2d": [[92.0, 170.0, 110.0, 190.0], [315.0, 80.0, 340.0, 102.0], [417.0, 173.0, 445.0, 201.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [556.0, 340.0, 592.0, 371.0], [358.0, 423.0, 374.0, 439.0], [247.0, 444.0, 269.0, 465.0], [85.0, 239.0, 112.0, 267.0], [359.0, 320.0, 387.0, 347.0], [218.0, 451.0, 243.0, 473.0], [156.0, 465.0, 174.0, 479.0], [32.0, 144.0, 56.0, 165.0]], "label": "sperm"}
```


[User] <image> Point to a cluster

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User]
<image> Point to all the cluster visible and output the total count.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Locate the sperm cluster and count them, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Detect all sperm cluster in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User]
<image> Point to sperm.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [424.0, 182.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 274.0], "label": "sperm"}, {"point_2d": [471.5, 258.0], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [602.0, 104.5], "label": "sperm"}, {"point_2d": [576.0, 354.5], "label": "sperm"}, {"point_2d": [366.0, 431.0], "label": "sperm"}, {"point_2d": [258.0, 459.5], "label": "sperm"}, {"point_2d": [123.5, 272.0], "label": "sperm"}, {"point_2d": [146.5, 468.0], "label": "sperm"}, {"point_2d": [429.0, 344.5], "label": "sperm"}, {"point_2d": [597.0, 468.0], "label": "sperm"}, {"point_2d": [46.0, 153.5], "label": "sperm"}]
```


[User] <image> Draw a bounding box around normal sperm.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [410.0, 168.0, 438.0, 196.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [590.0, 90.0, 614.0, 119.0], "label": "normal sperm"}, {"bbox_2d": [558.0, 339.0, 594.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [247.0, 449.0, 269.0, 470.0], "label": "normal sperm"}, {"bbox_2d": [110.0, 258.0, 137.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [133.0, 456.0, 160.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [415.0, 331.0, 443.0, 358.0], "label": "normal sperm"}, {"bbox_2d": [585.0, 458.0, 609.0, 478.0], "label": "normal sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "normal sperm"}]
```


[User] <image> Point at the sperm and then count them.

[Assistant]
```json
{"count": 17, "label": "sperm"}
```


[User] <image> Count the normal sperm in the image, then point to them.

[Assistant]
```json
{"count": 17, "point_2d": [[102.0, 180.0], [327.5, 91.0], [424.0, 182.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [602.0, 104.5], [576.0, 354.5], [366.0, 431.0], [258.0, 459.5], [123.5, 272.0], [146.5, 468.0], [429.0, 344.5], [597.0, 468.0], [46.0, 153.5]], "label": "sperm"}
```


[User] <image> Draw bounding boxes around every normal sperm and then provide the total count.

[Assistant]
```json
{"count": 17, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [410.0, 168.0, 438.0, 196.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [590.0, 90.0, 614.0, 119.0], [558.0, 339.0, 594.0, 370.0], [358.0, 423.0, 374.0, 439.0], [247.0, 449.0, 269.0, 470.0], [110.0, 258.0, 137.0, 286.0], [133.0, 456.0, 160.0, 480.0], [415.0, 331.0, 443.0, 358.0], [585.0, 458.0, 609.0, 478.0], [34.0, 143.0, 58.0, 164.0]], "label": "sperm"}
```


[User] <image> Locate a sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Draw a bounding box around cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> count every sperm cluster

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Point to and count the sperm cluster in the picture.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Output the total count of sperm cluster in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Point to any normal sperms in the image.

[Assistant]
```json
[{"point_2d": [101.0, 180.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [432.0, 187.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 274.0], "label": "normal sperm"}, {"point_2d": [471.5, 258.0], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [574.0, 355.5], "label": "normal sperm"}, {"point_2d": [366.0, 431.0], "label": "normal sperm"}, {"point_2d": [259.0, 453.5], "label": "normal sperm"}, {"point_2d": [96.5, 253.0], "label": "normal sperm"}, {"point_2d": [371.0, 327.5], "label": "normal sperm"}, {"point_2d": [227.5, 453.0], "label": "normal sperm"}, {"point_2d": [154.0, 473.0], "label": "normal sperm"}, {"point_2d": [44.0, 155.5], "label": "normal sperm"}]
```


[User] <image> Generate bounding box coordinates for the sperm.

[Assistant]
```json
[{"bbox_2d": [92.0, 170.0, 110.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [418.0, 173.0, 446.0, 201.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [556.0, 340.0, 592.0, 371.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [248.0, 443.0, 270.0, 464.0], "label": "sperm"}, {"bbox_2d": [83.0, 239.0, 110.0, 267.0], "label": "sperm"}, {"bbox_2d": [357.0, 314.0, 385.0, 341.0], "label": "sperm"}, {"bbox_2d": [215.0, 442.0, 240.0, 464.0], "label": "sperm"}, {"bbox_2d": [145.0, 466.0, 163.0, 480.0], "label": "sperm"}, {"bbox_2d": [32.0, 145.0, 56.0, 166.0], "label": "sperm"}]
```


[User] <image> Point and count normal sperm

[Assistant]
```json
{"count": 17, "label": "normal sperm"}
```


[User] <image> Point to all normal sperm in the image and then count them.

[Assistant]
```json
{"count": 17, "point_2d": [[101.0, 180.0], [327.5, 91.0], [432.0, 187.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [574.0, 355.5], [366.0, 431.0], [259.0, 453.5], [96.5, 253.0], [371.0, 327.5], [227.5, 453.0], [154.0, 473.0], [44.0, 155.5]], "label": "normal sperm"}
```


[User] <image> Draw bounding boxes around every normal sperm and then provide the total count.

[Assistant]
```json
{"count": 17, "bbox_2d": [[92.0, 170.0, 110.0, 190.0], [315.0, 80.0, 340.0, 102.0], [418.0, 173.0, 446.0, 201.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [556.0, 340.0, 592.0, 371.0], [358.0, 423.0, 374.0, 439.0], [248.0, 443.0, 270.0, 464.0], [83.0, 239.0, 110.0, 267.0], [357.0, 314.0, 385.0, 341.0], [215.0, 442.0, 240.0, 464.0], [145.0, 466.0, 163.0, 480.0], [32.0, 145.0, 56.0, 166.0]], "label": "normal sperm"}
```


[User] <image> Locate all clusters.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Identify the sperm cluster in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Tell me how many sperm cluster there are

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Show me each sperm cluster by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Mark all sperm cluster with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> If there are any sperms present, indicate their positions.

[Assistant]
```json
[{"point_2d": [90.0, 179.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [486.0, 278.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.5], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [13.5, 66.0], "label": "sperm"}, {"point_2d": [292.0, 434.0], "label": "sperm"}, {"point_2d": [264.5, 388.0], "label": "sperm"}, {"point_2d": [528.0, 188.5], "label": "sperm"}, {"point_2d": [487.5, 290.5], "label": "sperm"}, {"point_2d": [582.5, 241.5], "label": "sperm"}, {"point_2d": [35.0, 163.5], "label": "sperm"}]
```


[User] <image> Identify the sperm in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [81.0, 169.0, 99.0, 189.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [472.0, 264.0, 500.0, 292.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 284.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [0.0, 52.0, 27.0, 80.0], "label": "sperm"}, {"bbox_2d": [280.0, 422.0, 304.0, 446.0], "label": "sperm"}, {"bbox_2d": [252.0, 376.0, 277.0, 400.0], "label": "sperm"}, {"bbox_2d": [516.0, 176.0, 540.0, 201.0], "label": "sperm"}, {"bbox_2d": [474.0, 278.0, 501.0, 303.0], "label": "sperm"}, {"bbox_2d": [570.0, 228.0, 595.0, 255.0], "label": "sperm"}, {"bbox_2d": [23.0, 153.0, 47.0, 174.0], "label": "sperm"}]
```


[User] <image> Tell me how many normal sperm are in the image

[Assistant]
```json
{"count": 19, "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a point, then output how many there are.

[Assistant]
```json
{"count": 19, "point_2d": [[90.0, 179.0], [327.5, 91.0], [486.0, 278.0], [16.0, 180.0], [169.5, 275.5], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [13.5, 66.0], [292.0, 434.0], [264.5, 388.0], [528.0, 188.5], [487.5, 290.5], [582.5, 241.5], [35.0, 163.5]], "label": "normal sperm"}
```


[User] <image> Mark all normal sperm with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 19, "bbox_2d": [[81.0, 169.0, 99.0, 189.0], [315.0, 80.0, 340.0, 102.0], [472.0, 264.0, 500.0, 292.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 284.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [0.0, 52.0, 27.0, 80.0], [280.0, 422.0, 304.0, 446.0], [252.0, 376.0, 277.0, 400.0], [516.0, 176.0, 540.0, 201.0], [474.0, 278.0, 501.0, 303.0], [570.0, 228.0, 595.0, 255.0], [23.0, 153.0, 47.0, 174.0]], "label": "normal sperm"}
```


[User] <image> I am looking for clusters. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Tell me where each cluster is.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Point out every sperm cluster you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Output a list of bounding boxes for every sperm cluster and the overall count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Point to an normal sperm

[Assistant]
```json
[{"point_2d": [102.0, 180.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [425.0, 183.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 274.0], "label": "normal sperm"}, {"point_2d": [471.5, 258.0], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [602.0, 102.5], "label": "normal sperm"}, {"point_2d": [576.0, 354.5], "label": "normal sperm"}, {"point_2d": [366.0, 431.0], "label": "normal sperm"}, {"point_2d": [257.0, 458.5], "label": "normal sperm"}, {"point_2d": [117.5, 265.0], "label": "normal sperm"}, {"point_2d": [420.0, 344.5], "label": "normal sperm"}, {"point_2d": [622.0, 466.0], "label": "normal sperm"}, {"point_2d": [148.0, 475.5], "label": "normal sperm"}, {"point_2d": [46.0, 153.5], "label": "normal sperm"}]
```


[User] <image> Mark the sperm with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [93.0, 170.0, 111.0, 190.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [411.0, 169.0, 439.0, 197.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [590.0, 88.0, 614.0, 117.0], "label": "sperm"}, {"bbox_2d": [558.0, 339.0, 594.0, 370.0], "label": "sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "sperm"}, {"bbox_2d": [246.0, 448.0, 268.0, 469.0], "label": "sperm"}, {"bbox_2d": [104.0, 251.0, 131.0, 279.0], "label": "sperm"}, {"bbox_2d": [406.0, 331.0, 434.0, 358.0], "label": "sperm"}, {"bbox_2d": [610.0, 456.0, 634.0, 476.0], "label": "sperm"}, {"bbox_2d": [142.0, 471.0, 154.0, 480.0], "label": "sperm"}, {"bbox_2d": [34.0, 143.0, 58.0, 164.0], "label": "sperm"}]
```


[User] <image> Generate list of points showing where the normal sperm are and output the total count.

[Assistant]
```json
{"count": 17, "label": "normal sperm"}
```


[User] <image> Mark all visible normal sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 17, "point_2d": [[102.0, 180.0], [327.5, 91.0], [425.0, 183.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [602.0, 102.5], [576.0, 354.5], [366.0, 431.0], [257.0, 458.5], [117.5, 265.0], [420.0, 344.5], [622.0, 466.0], [148.0, 475.5], [46.0, 153.5]], "label": "normal sperm"}
```


[User] <image> Find all normal sperm in the image, draw bounding boxes around them, and then count them.

[Assistant]
```json
{"count": 17, "bbox_2d": [[93.0, 170.0, 111.0, 190.0], [315.0, 80.0, 340.0, 102.0], [411.0, 169.0, 439.0, 197.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [590.0, 88.0, 614.0, 117.0], [558.0, 339.0, 594.0, 370.0], [358.0, 423.0, 374.0, 439.0], [246.0, 448.0, 268.0, 469.0], [104.0, 251.0, 131.0, 279.0], [406.0, 331.0, 434.0, 358.0], [610.0, 456.0, 634.0, 476.0], [142.0, 471.0, 154.0, 480.0], [34.0, 143.0, 58.0, 164.0]], "label": "normal sperm"}
```


[User] <image> Point to every cluster

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Draw a bounding box around cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> If you see any sperm cluster in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Find all the sperm cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Count all sperm cluster in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Find any normal sperms

[Assistant]
```json
[{"point_2d": [101.0, 180.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [431.0, 187.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 274.0], "label": "normal sperm"}, {"point_2d": [471.5, 258.0], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [574.0, 355.5], "label": "normal sperm"}, {"point_2d": [366.0, 431.0], "label": "normal sperm"}, {"point_2d": [258.0, 454.5], "label": "normal sperm"}, {"point_2d": [99.5, 253.0], "label": "normal sperm"}, {"point_2d": [375.0, 332.5], "label": "normal sperm"}, {"point_2d": [232.5, 465.0], "label": "normal sperm"}, {"point_2d": [164.0, 472.0], "label": "normal sperm"}, {"point_2d": [44.0, 154.5], "label": "normal sperm"}]
```


[User] <image> Specify the bounding box for the normal sperm in the image.

[Assistant]
```json
[{"bbox_2d": [92.0, 170.0, 110.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [417.0, 173.0, 445.0, 201.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 266.0, 180.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [461.0, 247.0, 482.0, 269.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [556.0, 340.0, 592.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 423.0, 374.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [247.0, 444.0, 269.0, 465.0], "label": "normal sperm"}, {"bbox_2d": [86.0, 239.0, 113.0, 267.0], "label": "normal sperm"}, {"bbox_2d": [361.0, 319.0, 389.0, 346.0], "label": "normal sperm"}, {"bbox_2d": [220.0, 454.0, 245.0, 476.0], "label": "normal sperm"}, {"bbox_2d": [155.0, 465.0, 173.0, 479.0], "label": "normal sperm"}, {"bbox_2d": [32.0, 144.0, 56.0, 165.0], "label": "normal sperm"}]
```


[User] <image> Locate the normal sperm and count them

[Assistant]
```json
{"count": 17, "label": "normal sperm"}
```


[User] <image> Point out every sperm you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 17, "point_2d": [[101.0, 180.0], [327.5, 91.0], [431.0, 187.0], [16.0, 180.0], [169.5, 274.0], [471.5, 258.0], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [574.0, 355.5], [366.0, 431.0], [258.0, 454.5], [99.5, 253.0], [375.0, 332.5], [232.5, 465.0], [164.0, 472.0], [44.0, 154.5]], "label": "normal sperm"}
```


[User] <image> Detect all sperm in the image with bounding boxes, and then output their count.

[Assistant]
```json
{"count": 17, "bbox_2d": [[92.0, 170.0, 110.0, 190.0], [315.0, 80.0, 340.0, 102.0], [417.0, 173.0, 445.0, 201.0], [6.0, 170.0, 26.0, 190.0], [159.0, 266.0, 180.0, 282.0], [461.0, 247.0, 482.0, 269.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [556.0, 340.0, 592.0, 371.0], [358.0, 423.0, 374.0, 439.0], [247.0, 444.0, 269.0, 465.0], [86.0, 239.0, 113.0, 267.0], [361.0, 319.0, 389.0, 346.0], [220.0, 454.0, 245.0, 476.0], [155.0, 465.0, 173.0, 479.0], [32.0, 144.0, 56.0, 165.0]], "label": "normal sperm"}
```


[User]
<image> Help me find an object in the image by pointing to it.
Object: sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Outline the area containing cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User]
<image> Object: cluster
Instruction: Point to the object and output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Locate the cluster and count them, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Provide the total number of cluster and for each, supply a bounding box.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Locate normal sperm.

[Assistant]
```json
[{"point_2d": [90.0, 179.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [472.0, 283.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.5], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [18.5, 74.0], "label": "normal sperm"}, {"point_2d": [292.0, 434.0], "label": "normal sperm"}, {"point_2d": [243.5, 381.5], "label": "normal sperm"}, {"point_2d": [521.0, 215.0], "label": "normal sperm"}, {"point_2d": [504.5, 271.5], "label": "normal sperm"}, {"point_2d": [595.5, 259.5], "label": "normal sperm"}, {"point_2d": [35.0, 163.5], "label": "normal sperm"}]
```


[User] <image> Return a bounding box that encloses sperm.

[Assistant]
```json
[{"bbox_2d": [81.0, 169.0, 99.0, 189.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [458.0, 269.0, 486.0, 297.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 284.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [5.0, 60.0, 32.0, 88.0], "label": "sperm"}, {"bbox_2d": [280.0, 422.0, 304.0, 446.0], "label": "sperm"}, {"bbox_2d": [233.0, 371.0, 254.0, 392.0], "label": "sperm"}, {"bbox_2d": [509.0, 203.0, 533.0, 227.0], "label": "sperm"}, {"bbox_2d": [491.0, 259.0, 518.0, 284.0], "label": "sperm"}, {"bbox_2d": [583.0, 246.0, 608.0, 273.0], "label": "sperm"}, {"bbox_2d": [23.0, 153.0, 47.0, 174.0], "label": "sperm"}]
```


[User] <image> In all the picture, how many sperm are there?

[Assistant]
```json
{"count": 19, "label": "sperm"}
```


[User] <image> Identify all occurrences of normal sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 19, "point_2d": [[90.0, 179.0], [327.5, 91.0], [472.0, 283.0], [16.0, 180.0], [169.5, 275.5], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [18.5, 74.0], [292.0, 434.0], [243.5, 381.5], [521.0, 215.0], [504.5, 271.5], [595.5, 259.5], [35.0, 163.5]], "label": "sperm"}
```


[User] <image> Output the total count of normal sperm in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 19, "bbox_2d": [[81.0, 169.0, 99.0, 189.0], [315.0, 80.0, 340.0, 102.0], [458.0, 269.0, 486.0, 297.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 284.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [5.0, 60.0, 32.0, 88.0], [280.0, 422.0, 304.0, 446.0], [233.0, 371.0, 254.0, 392.0], [509.0, 203.0, 533.0, 227.0], [491.0, 259.0, 518.0, 284.0], [583.0, 246.0, 608.0, 273.0], [23.0, 153.0, 47.0, 174.0]], "label": "sperm"}
```


[User] <image> Point to any sperm clusters in the image

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Outline the area containing cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Point and count cluster

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Find all the cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Output a list of bounding boxes for every cluster and the overall count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Find a "sperm".

[Assistant]
```json
[{"point_2d": [90.0, 179.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [483.0, 279.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.5], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [14.0, 67.0], "label": "sperm"}, {"point_2d": [292.0, 434.0], "label": "sperm"}, {"point_2d": [266.5, 390.0], "label": "sperm"}, {"point_2d": [525.0, 195.0], "label": "sperm"}, {"point_2d": [500.0, 282.0], "label": "sperm"}, {"point_2d": [585.5, 246.5], "label": "sperm"}, {"point_2d": [35.0, 163.5], "label": "sperm"}]
```


[User] <image> Draw a bounding box around normal sperm.

[Assistant]
```json
[{"bbox_2d": [81.0, 169.0, 99.0, 189.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [469.0, 265.0, 497.0, 293.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 284.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 53.0, 28.0, 81.0], "label": "normal sperm"}, {"bbox_2d": [280.0, 422.0, 304.0, 446.0], "label": "normal sperm"}, {"bbox_2d": [256.0, 380.0, 277.0, 400.0], "label": "normal sperm"}, {"bbox_2d": [513.0, 183.0, 537.0, 207.0], "label": "normal sperm"}, {"bbox_2d": [486.0, 270.0, 514.0, 294.0], "label": "normal sperm"}, {"bbox_2d": [573.0, 233.0, 598.0, 260.0], "label": "normal sperm"}, {"bbox_2d": [23.0, 153.0, 47.0, 174.0], "label": "normal sperm"}]
```


[User] <image> Point at normal sperm and then tell me the count.

[Assistant]
```json
{"count": 19, "label": "normal sperm"}
```


[User] <image> Find all the normal sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 19, "point_2d": [[90.0, 179.0], [327.5, 91.0], [483.0, 279.0], [16.0, 180.0], [169.5, 275.5], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [14.0, 67.0], [292.0, 434.0], [266.5, 390.0], [525.0, 195.0], [500.0, 282.0], [585.5, 246.5], [35.0, 163.5]], "label": "normal sperm"}
```


[User] <image> Count the normal sperm and enclose each in a bounding box.

[Assistant]
```json
{"count": 19, "bbox_2d": [[81.0, 169.0, 99.0, 189.0], [315.0, 80.0, 340.0, 102.0], [469.0, 265.0, 497.0, 293.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 284.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [0.0, 53.0, 28.0, 81.0], [280.0, 422.0, 304.0, 446.0], [256.0, 380.0, 277.0, 400.0], [513.0, 183.0, 537.0, 207.0], [486.0, 270.0, 514.0, 294.0], [573.0, 233.0, 598.0, 260.0], [23.0, 153.0, 47.0, 174.0]], "label": "normal sperm"}
```


[User] <image> Where are the clusters?

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Return the bounding box of the cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Tell me how many cluster there are

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Point to and count the sperm cluster in the picture.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Output a list of bounding boxes for every sperm cluster and the overall count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Locate the sperm.

[Assistant]
```json
[{"point_2d": [100.0, 179.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [451.0, 217.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [73.5, 223.0], "label": "sperm"}, {"point_2d": [288.0, 388.5], "label": "sperm"}, {"point_2d": [146.5, 367.0], "label": "sperm"}, {"point_2d": [183.5, 429.0], "label": "sperm"}, {"point_2d": [50.0, 469.5], "label": "sperm"}, {"point_2d": [41.0, 157.5], "label": "sperm"}]
```


[User] <image> Find the region corresponding to sperm and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [91.0, 169.0, 109.0, 189.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [437.0, 203.0, 465.0, 231.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [60.0, 209.0, 87.0, 237.0], "label": "sperm"}, {"bbox_2d": [274.0, 375.0, 302.0, 402.0], "label": "sperm"}, {"bbox_2d": [134.0, 356.0, 159.0, 378.0], "label": "sperm"}, {"bbox_2d": [173.0, 419.0, 194.0, 439.0], "label": "sperm"}, {"bbox_2d": [43.0, 464.0, 57.0, 475.0], "label": "sperm"}, {"bbox_2d": [29.0, 147.0, 53.0, 168.0], "label": "sperm"}]
```


[User] <image> Point to every sperm

[Assistant]
```json
{"count": 18, "label": "sperm"}
```


[User] <image> Locate the sperm and count them, then point to them.

[Assistant]
```json
{"count": 18, "point_2d": [[100.0, 179.0], [327.5, 91.0], [451.0, 217.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [73.5, 223.0], [288.0, 388.5], [146.5, 367.0], [183.5, 429.0], [50.0, 469.5], [41.0, 157.5]], "label": "sperm"}
```


[User] <image> Mark each sperm with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 18, "bbox_2d": [[91.0, 169.0, 109.0, 189.0], [315.0, 80.0, 340.0, 102.0], [437.0, 203.0, 465.0, 231.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [60.0, 209.0, 87.0, 237.0], [274.0, 375.0, 302.0, 402.0], [134.0, 356.0, 159.0, 378.0], [173.0, 419.0, 194.0, 439.0], [43.0, 464.0, 57.0, 475.0], [29.0, 147.0, 53.0, 168.0]], "label": "sperm"}
```


[User] <image> Locate sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Locate and mark cluster with a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Point at the sperm cluster and then count them.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Point to all sperm cluster in the image and then count them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Outline all instances of sperm cluster with bounding boxes, then return the count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> I am looking for sperms. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [90.0, 179.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [471.0, 283.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.5], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [19.0, 75.0], "label": "sperm"}, {"point_2d": [292.0, 434.0], "label": "sperm"}, {"point_2d": [243.5, 379.5], "label": "sperm"}, {"point_2d": [518.0, 215.0], "label": "sperm"}, {"point_2d": [504.5, 271.5], "label": "sperm"}, {"point_2d": [596.5, 260.5], "label": "sperm"}, {"point_2d": [35.0, 163.5], "label": "sperm"}]
```


[User] <image> Outline the area containing sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [81.0, 169.0, 99.0, 189.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [457.0, 269.0, 485.0, 297.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 284.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [5.0, 61.0, 33.0, 89.0], "label": "sperm"}, {"bbox_2d": [280.0, 422.0, 304.0, 446.0], "label": "sperm"}, {"bbox_2d": [233.0, 369.0, 254.0, 390.0], "label": "sperm"}, {"bbox_2d": [506.0, 203.0, 530.0, 227.0], "label": "sperm"}, {"bbox_2d": [491.0, 259.0, 518.0, 284.0], "label": "sperm"}, {"bbox_2d": [584.0, 247.0, 609.0, 274.0], "label": "sperm"}, {"bbox_2d": [23.0, 153.0, 47.0, 174.0], "label": "sperm"}]
```


[User] <image> Count each normal sperm

[Assistant]
```json
{"count": 19, "label": "normal sperm"}
```


[User] <image> Mark all visible sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 19, "point_2d": [[90.0, 179.0], [327.5, 91.0], [471.0, 283.0], [16.0, 180.0], [169.5, 275.5], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [19.0, 75.0], [292.0, 434.0], [243.5, 379.5], [518.0, 215.0], [504.5, 271.5], [596.5, 260.5], [35.0, 163.5]], "label": "normal sperm"}
```