[User] <image> Detect all sperm in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 17, "bbox_2d": [[244.0, 365.0, 269.0, 386.0], [517.0, 371.0, 541.0, 392.0], [487.0, 316.0, 512.0, 338.0], [475.0, 258.0, 500.0, 282.0], [171.0, 0.0, 199.0, 14.0], [306.0, 224.0, 330.0, 255.0], [579.0, 57.0, 597.0, 80.0], [47.0, 211.0, 68.0, 233.0], [160.0, 214.0, 195.0, 236.0], [161.0, 256.0, 181.0, 279.0], [425.0, 182.0, 445.0, 204.0], [547.0, 149.0, 571.0, 173.0], [480.0, 119.0, 505.0, 144.0], [533.0, 303.0, 563.0, 329.0], [284.0, 92.0, 310.0, 112.0], [30.0, 20.0, 54.0, 40.0], [380.0, 0.0, 408.0, 19.0]], "label": "normal sperm"}
```


[User] <image> Generate a list of points showing where the sperm clusters are.

[Assistant]
```json
[{"point_2d": [123.5, 369.0], "label": "sperm cluster"}]
```


[User] <image> Draw a bounding box around cluster.

[Assistant]
```json
[{"bbox_2d": [92.0, 337.0, 155.0, 401.0], "label": "cluster"}]
```


[User] <image> In all the picture, how many cluster are there?

[Assistant]
```json
{"count": 1, "label": "cluster"}
```


[User] <image> Point to all cluster in the image and then count them.

[Assistant]
```json
{"count": 1, "point_2d": [[123.5, 369.0]], "label": "cluster"}
```


[User] <image> Identify each cluster by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[92.0, 337.0, 155.0, 401.0]], "label": "cluster"}
```


[User] <image> Show me where the pinheads are

[Assistant]
```json
[{"point_2d": [116.5, 348.5], "label": "pinhead"}]
```


[User] <image> Find the region corresponding to pinhead and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [107.0, 340.0, 126.0, 357.0], "label": "pinhead"}]
```


[User] <image> In all the picture, how many pinhead sperm are there?

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Point to all pinhead in the image and then count them.

[Assistant]
```json
{"count": 1, "point_2d": [[116.5, 348.5]], "label": "pinhead sperm"}
```


[User] <image> Provide the total number of pinhead and for each, supply a bounding box.

[Assistant]
```json
{"count": 1, "bbox_2d": [[107.0, 340.0, 126.0, 357.0]], "label": "pinhead sperm"}
```


[User] <image> Point to any sperms in the image

[Assistant]
```json
[{"point_2d": [256.5, 375.5], "label": "sperm"}, {"point_2d": [529.0, 381.5], "label": "sperm"}, {"point_2d": [499.5, 327.0], "label": "sperm"}, {"point_2d": [487.5, 270.0], "label": "sperm"}, {"point_2d": [186.0, 7.0], "label": "sperm"}, {"point_2d": [313.5, 243.5], "label": "sperm"}, {"point_2d": [588.0, 68.5], "label": "sperm"}, {"point_2d": [57.5, 222.0], "label": "sperm"}, {"point_2d": [177.5, 225.0], "label": "sperm"}, {"point_2d": [169.0, 266.5], "label": "sperm"}, {"point_2d": [435.0, 193.0], "label": "sperm"}, {"point_2d": [564.0, 158.0], "label": "sperm"}, {"point_2d": [492.5, 131.5], "label": "sperm"}, {"point_2d": [548.0, 316.0], "label": "sperm"}, {"point_2d": [297.0, 102.0], "label": "sperm"}, {"point_2d": [44.0, 28.0], "label": "sperm"}, {"point_2d": [398.0, 10.5], "label": "sperm"}]
```


[User] <image> Find the normal sperm in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [244.0, 365.0, 269.0, 386.0], "label": "normal sperm"}, {"bbox_2d": [517.0, 371.0, 541.0, 392.0], "label": "normal sperm"}, {"bbox_2d": [487.0, 316.0, 512.0, 338.0], "label": "normal sperm"}, {"bbox_2d": [475.0, 258.0, 500.0, 282.0], "label": "normal sperm"}, {"bbox_2d": [172.0, 0.0, 200.0, 14.0], "label": "normal sperm"}, {"bbox_2d": [301.0, 228.0, 326.0, 259.0], "label": "normal sperm"}, {"bbox_2d": [579.0, 57.0, 597.0, 80.0], "label": "normal sperm"}, {"bbox_2d": [47.0, 211.0, 68.0, 233.0], "label": "normal sperm"}, {"bbox_2d": [160.0, 214.0, 195.0, 236.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 255.0, 179.0, 278.0], "label": "normal sperm"}, {"bbox_2d": [425.0, 182.0, 445.0, 204.0], "label": "normal sperm"}, {"bbox_2d": [552.0, 146.0, 576.0, 170.0], "label": "normal sperm"}, {"bbox_2d": [480.0, 119.0, 505.0, 144.0], "label": "normal sperm"}, {"bbox_2d": [533.0, 303.0, 563.0, 329.0], "label": "normal sperm"}, {"bbox_2d": [284.0, 92.0, 310.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [32.0, 18.0, 56.0, 38.0], "label": "normal sperm"}, {"bbox_2d": [384.0, 0.0, 412.0, 21.0], "label": "normal sperm"}]
```


[User] <image> Can you count the number of sperm in the image?

[Assistant]
```json
{"count": 17, "label": "sperm"}
```


[User] <image> Identify all occurrences of normal sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 17, "point_2d": [[256.5, 375.5], [529.0, 381.5], [499.5, 327.0], [487.5, 270.0], [186.0, 7.0], [313.5, 243.5], [588.0, 68.5], [57.5, 222.0], [177.5, 225.0], [169.0, 266.5], [435.0, 193.0], [564.0, 158.0], [492.5, 131.5], [548.0, 316.0], [297.0, 102.0], [44.0, 28.0], [398.0, 10.5]], "label": "sperm"}
```


[User] <image> Locate all instances of normal sperm, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 17, "bbox_2d": [[244.0, 365.0, 269.0, 386.0], [517.0, 371.0, 541.0, 392.0], [487.0, 316.0, 512.0, 338.0], [475.0, 258.0, 500.0, 282.0], [172.0, 0.0, 200.0, 14.0], [301.0, 228.0, 326.0, 259.0], [579.0, 57.0, 597.0, 80.0], [47.0, 211.0, 68.0, 233.0], [160.0, 214.0, 195.0, 236.0], [159.0, 255.0, 179.0, 278.0], [425.0, 182.0, 445.0, 204.0], [552.0, 146.0, 576.0, 170.0], [480.0, 119.0, 505.0, 144.0], [533.0, 303.0, 563.0, 329.0], [284.0, 92.0, 310.0, 112.0], [32.0, 18.0, 56.0, 38.0], [384.0, 0.0, 412.0, 21.0]], "label": "sperm"}
```


[User] <image> Locate every cluster.

[Assistant]
```json
[{"point_2d": [123.5, 369.0], "label": "cluster"}]
```


[User] <image> Mark the cluster with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [92.0, 337.0, 155.0, 401.0], "label": "cluster"}]
```


[User] <image> Show me where the sperm cluster are and output the total count.

[Assistant]
```json
{"count": 1, "label": "sperm cluster"}
```


[User] <image> Point to each instance of cluster and then output their total number.

[Assistant]
```json
{"count": 1, "point_2d": [[123.5, 369.0]], "label": "sperm cluster"}
```


[User] <image> Count all cluster in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 1, "bbox_2d": [[92.0, 337.0, 155.0, 401.0]], "label": "sperm cluster"}
```


[User] <image> Find pinhead.

[Assistant]
```json
[{"point_2d": [116.5, 348.5], "label": "pinhead"}]
```


[User] <image> Outline the pinhead using a bounding box.

[Assistant]
```json
[{"bbox_2d": [107.0, 340.0, 126.0, 357.0], "label": "pinhead"}]
```


[User] <image> Point to all the visible pinhead output the total count.

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Find each pinhead. How many are there? Point to them.

[Assistant]
```json
{"count": 1, "point_2d": [[116.5, 348.5]], "label": "pinhead"}
```


[User] <image> Detect all pinhead in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[107.0, 340.0, 126.0, 357.0]], "label": "pinhead"}
```


[User] <image> Point to a normal sperm

[Assistant]
```json
[{"point_2d": [256.5, 375.5], "label": "normal sperm"}, {"point_2d": [529.0, 381.5], "label": "normal sperm"}, {"point_2d": [499.5, 327.0], "label": "normal sperm"}, {"point_2d": [487.5, 270.0], "label": "normal sperm"}, {"point_2d": [186.0, 7.0], "label": "normal sperm"}, {"point_2d": [309.5, 247.5], "label": "normal sperm"}, {"point_2d": [588.0, 68.5], "label": "normal sperm"}, {"point_2d": [57.5, 222.0], "label": "normal sperm"}, {"point_2d": [177.5, 225.0], "label": "normal sperm"}, {"point_2d": [167.0, 265.5], "label": "normal sperm"}, {"point_2d": [435.0, 193.0], "label": "normal sperm"}, {"point_2d": [568.0, 155.0], "label": "normal sperm"}, {"point_2d": [492.5, 131.5], "label": "normal sperm"}, {"point_2d": [548.0, 316.0], "label": "normal sperm"}, {"point_2d": [297.0, 102.0], "label": "normal sperm"}, {"point_2d": [46.0, 29.0], "label": "normal sperm"}, {"point_2d": [402.0, 11.5], "label": "normal sperm"}]
```


[User] <image> Locate and mark sperm with a bounding box.

[Assistant]
```json
[{"bbox_2d": [244.0, 365.0, 269.0, 386.0], "label": "sperm"}, {"bbox_2d": [517.0, 371.0, 541.0, 392.0], "label": "sperm"}, {"bbox_2d": [487.0, 316.0, 512.0, 338.0], "label": "sperm"}, {"bbox_2d": [475.0, 258.0, 500.0, 282.0], "label": "sperm"}, {"bbox_2d": [172.0, 0.0, 200.0, 14.0], "label": "sperm"}, {"bbox_2d": [297.0, 232.0, 322.0, 263.0], "label": "sperm"}, {"bbox_2d": [579.0, 57.0, 597.0, 80.0], "label": "sperm"}, {"bbox_2d": [47.0, 211.0, 68.0, 233.0], "label": "sperm"}, {"bbox_2d": [160.0, 214.0, 195.0, 236.0], "label": "sperm"}, {"bbox_2d": [157.0, 254.0, 177.0, 277.0], "label": "sperm"}, {"bbox_2d": [425.0, 182.0, 445.0, 204.0], "label": "sperm"}, {"bbox_2d": [556.0, 143.0, 580.0, 167.0], "label": "sperm"}, {"bbox_2d": [480.0, 119.0, 505.0, 144.0], "label": "sperm"}, {"bbox_2d": [533.0, 303.0, 563.0, 329.0], "label": "sperm"}, {"bbox_2d": [284.0, 92.0, 310.0, 112.0], "label": "sperm"}, {"bbox_2d": [34.0, 19.0, 58.0, 39.0], "label": "sperm"}, {"bbox_2d": [388.0, 0.0, 416.0, 23.0], "label": "sperm"}]
```


[User] <image> How many normal sperm are there?

[Assistant]
```json
{"count": 17, "label": "normal sperm"}
```


[User] <image> Mark all visible normal sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 17, "point_2d": [[256.5, 375.5], [529.0, 381.5], [499.5, 327.0], [487.5, 270.0], [186.0, 7.0], [309.5, 247.5], [588.0, 68.5], [57.5, 222.0], [177.5, 225.0], [167.0, 265.5], [435.0, 193.0], [568.0, 155.0], [492.5, 131.5], [548.0, 316.0], [297.0, 102.0], [46.0, 29.0], [402.0, 11.5]], "label": "normal sperm"}
```


[User] <image> Output a list of bounding boxes for every normal sperm and the overall count.

[Assistant]
```json
{"count": 17, "bbox_2d": [[244.0, 365.0, 269.0, 386.0], [517.0, 371.0, 541.0, 392.0], [487.0, 316.0, 512.0, 338.0], [475.0, 258.0, 500.0, 282.0], [172.0, 0.0, 200.0, 14.0], [297.0, 232.0, 322.0, 263.0], [579.0, 57.0, 597.0, 80.0], [47.0, 211.0, 68.0, 233.0], [160.0, 214.0, 195.0, 236.0], [157.0, 254.0, 177.0, 277.0], [425.0, 182.0, 445.0, 204.0], [556.0, 143.0, 580.0, 167.0], [480.0, 119.0, 505.0, 144.0], [533.0, 303.0, 563.0, 329.0], [284.0, 92.0, 310.0, 112.0], [34.0, 19.0, 58.0, 39.0], [388.0, 0.0, 416.0, 23.0]], "label": "normal sperm"}
```


[User] <image> Can you see any clusters in the image? Point to them.

[Assistant]
```json
[{"point_2d": [123.5, 369.0], "label": "cluster"}]
```


[User] <image> Enclose cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [92.0, 337.0, 155.0, 401.0], "label": "cluster"}]
```


[User] <image> Locate every cluster and count them

[Assistant]
```json
{"count": 1, "label": "cluster"}
```


[User] <image> Point to each instance of sperm cluster and then output their total number.

[Assistant]
```json
{"count": 1, "point_2d": [[123.5, 369.0]], "label": "cluster"}
```


[User] <image> Mark each sperm cluster with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 1, "bbox_2d": [[92.0, 337.0, 155.0, 401.0]], "label": "cluster"}
```


[User] <image> Locate each pinhead sperm in the image.

[Assistant]
```json
[{"point_2d": [116.5, 348.5], "label": "pinhead sperm"}]
```


[User] <image> Outline the area containing pinhead sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [107.0, 340.0, 126.0, 357.0], "label": "pinhead sperm"}]
```


[User] <image> Find all the pinhead. How many are there?

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Identify all occurrences of pinhead by marking them, and then provide the count.

[Assistant]
```json
{"count": 1, "point_2d": [[116.5, 348.5]], "label": "pinhead"}
```


[User] <image> Mark each pinhead with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 1, "bbox_2d": [[107.0, 340.0, 126.0, 357.0]], "label": "pinhead"}
```


[User] <image> Find normal sperm.

[Assistant]
```json
[{"point_2d": [256.5, 375.5], "label": "normal sperm"}, {"point_2d": [529.0, 381.5], "label": "normal sperm"}, {"point_2d": [499.5, 327.0], "label": "normal sperm"}, {"point_2d": [487.5, 270.0], "label": "normal sperm"}, {"point_2d": [186.0, 7.0], "label": "normal sperm"}, {"point_2d": [314.5, 252.0], "label": "normal sperm"}, {"point_2d": [588.0, 68.5], "label": "normal sperm"}, {"point_2d": [57.5, 222.0], "label": "normal sperm"}, {"point_2d": [177.5, 225.0], "label": "normal sperm"}, {"point_2d": [166.0, 264.5], "label": "normal sperm"}, {"point_2d": [435.0, 193.0], "label": "normal sperm"}, {"point_2d": [571.0, 148.0], "label": "normal sperm"}, {"point_2d": [492.5, 131.5], "label": "normal sperm"}, {"point_2d": [548.0, 316.0], "label": "normal sperm"}, {"point_2d": [297.0, 102.0], "label": "normal sperm"}, {"point_2d": [48.0, 35.0], "label": "normal sperm"}, {"point_2d": [405.0, 12.0], "label": "normal sperm"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [244.0, 365.0, 269.0, 386.0], "label": "sperm"}, {"bbox_2d": [517.0, 371.0, 541.0, 392.0], "label": "sperm"}, {"bbox_2d": [487.0, 316.0, 512.0, 338.0], "label": "sperm"}, {"bbox_2d": [475.0, 258.0, 500.0, 282.0], "label": "sperm"}, {"bbox_2d": [172.0, 0.0, 200.0, 14.0], "label": "sperm"}, {"bbox_2d": [302.0, 236.0, 327.0, 268.0], "label": "sperm"}, {"bbox_2d": [579.0, 57.0, 597.0, 80.0], "label": "sperm"}, {"bbox_2d": [47.0, 211.0, 68.0, 233.0], "label": "sperm"}, {"bbox_2d": [160.0, 214.0, 195.0, 236.0], "label": "sperm"}, {"bbox_2d": [156.0, 253.0, 176.0, 276.0], "label": "sperm"}, {"bbox_2d": [425.0, 182.0, 445.0, 204.0], "label": "sperm"}, {"bbox_2d": [559.0, 136.0, 583.0, 160.0], "label": "sperm"}, {"bbox_2d": [480.0, 119.0, 505.0, 144.0], "label": "sperm"}, {"bbox_2d": [533.0, 303.0, 563.0, 329.0], "label": "sperm"}, {"bbox_2d": [284.0, 92.0, 310.0, 112.0], "label": "sperm"}, {"bbox_2d": [36.0, 25.0, 60.0, 45.0], "label": "sperm"}, {"bbox_2d": [391.0, 0.0, 419.0, 24.0], "label": "sperm"}]
```


[User] <image> If there are any normal sperm present, indicate their positions and output the total count.

[Assistant]
```json
{"count": 17, "label": "normal sperm"}
```


[User] <image> Point to all normal sperm in the image and then count them.

[Assistant]
```json
{"count": 17, "point_2d": [[256.5, 375.5], [529.0, 381.5], [499.5, 327.0], [487.5, 270.0], [186.0, 7.0], [314.5, 252.0], [588.0, 68.5], [57.5, 222.0], [177.5, 225.0], [166.0, 264.5], [435.0, 193.0], [571.0, 148.0], [492.5, 131.5], [548.0, 316.0], [297.0, 102.0], [48.0, 35.0], [405.0, 12.0]], "label": "normal sperm"}
```


[User] <image> Identify all normal sperm in the image, count them, and provide bounding box coordinates for each.

[Assistant]
```json
{"count": 17, "bbox_2d": [[244.0, 365.0, 269.0, 386.0], [517.0, 371.0, 541.0, 392.0], [487.0, 316.0, 512.0, 338.0], [475.0, 258.0, 500.0, 282.0], [172.0, 0.0, 200.0, 14.0], [302.0, 236.0, 327.0, 268.0], [579.0, 57.0, 597.0, 80.0], [47.0, 211.0, 68.0, 233.0], [160.0, 214.0, 195.0, 236.0], [156.0, 253.0, 176.0, 276.0], [425.0, 182.0, 445.0, 204.0], [559.0, 136.0, 583.0, 160.0], [480.0, 119.0, 505.0, 144.0], [533.0, 303.0, 563.0, 329.0], [284.0, 92.0, 310.0, 112.0], [36.0, 25.0, 60.0, 45.0], [391.0, 0.0, 419.0, 24.0]], "label": "normal sperm"}
```


[User] <image> Find the "cluster".

[Assistant]
```json
[{"point_2d": [123.5, 369.0], "label": "cluster"}]
```


[User] <image> Outline the area containing cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [92.0, 337.0, 155.0, 401.0], "label": "cluster"}]
```


[User] <image> Point and count sperm cluster

[Assistant]
```json
{"count": 1, "label": "sperm cluster"}
```


[User] <image> Point to and count the sperm cluster in the picture.

[Assistant]
```json
{"count": 1, "point_2d": [[123.5, 369.0]], "label": "sperm cluster"}
```


[User] <image> Count the sperm cluster and enclose each in a bounding box.

[Assistant]
```json
{"count": 1, "bbox_2d": [[92.0, 337.0, 155.0, 401.0]], "label": "sperm cluster"}
```


[User] <image> Point to every pinhead

[Assistant]
```json
[{"point_2d": [116.5, 348.5], "label": "pinhead"}]
```


[User] <image> Return a bounding box that encloses pinhead.

[Assistant]
```json
[{"bbox_2d": [107.0, 340.0, 126.0, 357.0], "label": "pinhead"}]
```


[User] <image> find any pinhead sperm in the picture and output the total count.

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Identify all occurrences of pinhead sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 1, "point_2d": [[116.5, 348.5]], "label": "pinhead sperm"}
```


[User] <image> Detect all pinhead sperm in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[107.0, 340.0, 126.0, 357.0]], "label": "pinhead sperm"}
```


[User] <image> If there are any sperms present, indicate their positions.

[Assistant]
```json
[{"point_2d": [233.5, 42.5], "label": "sperm"}, {"point_2d": [264.5, 10.0], "label": "sperm"}, {"point_2d": [173.0, 32.0], "label": "sperm"}, {"point_2d": [167.0, 38.5], "label": "sperm"}, {"point_2d": [155.0, 56.5], "label": "sperm"}, {"point_2d": [98.0, 74.0], "label": "sperm"}, {"point_2d": [93.0, 169.0], "label": "sperm"}, {"point_2d": [105.5, 194.0], "label": "sperm"}, {"point_2d": [142.5, 254.0], "label": "sperm"}, {"point_2d": [268.0, 331.5], "label": "sperm"}, {"point_2d": [359.0, 367.5], "label": "sperm"}, {"point_2d": [462.5, 101.0], "label": "sperm"}, {"point_2d": [462.5, 19.5], "label": "sperm"}, {"point_2d": [518.0, 35.5], "label": "sperm"}, {"point_2d": [412.0, 100.0], "label": "sperm"}, {"point_2d": [565.0, 215.5], "label": "sperm"}, {"point_2d": [555.5, 249.0], "label": "sperm"}, {"point_2d": [615.5, 247.5], "label": "sperm"}, {"point_2d": [623.5, 299.0], "label": "sperm"}, {"point_2d": [552.5, 446.0], "label": "sperm"}, {"point_2d": [77.5, 467.5], "label": "sperm"}, {"point_2d": [630.5, 52.5], "label": "sperm"}, {"point_2d": [622.0, 370.5], "label": "sperm"}, {"point_2d": [135.5, 79.0], "label": "sperm"}, {"point_2d": [587.0, 207.0], "label": "sperm"}, {"point_2d": [608.5, 293.0], "label": "sperm"}, {"point_2d": [505.5, 436.5], "label": "sperm"}]
```


[User] <image> Mark the sperm with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [222.0, 31.0, 245.0, 54.0], "label": "sperm"}, {"bbox_2d": [253.0, 0.0, 276.0, 20.0], "label": "sperm"}, {"bbox_2d": [162.0, 19.0, 184.0, 45.0], "label": "sperm"}, {"bbox_2d": [156.0, 27.0, 178.0, 50.0], "label": "sperm"}, {"bbox_2d": [141.0, 44.0, 169.0, 69.0], "label": "sperm"}, {"bbox_2d": [86.0, 60.0, 110.0, 88.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 178.0, 119.0, 210.0], "label": "sperm"}, {"bbox_2d": [121.0, 231.0, 164.0, 277.0], "label": "sperm"}, {"bbox_2d": [253.0, 315.0, 283.0, 348.0], "label": "sperm"}, {"bbox_2d": [345.0, 353.0, 373.0, 382.0], "label": "sperm"}, {"bbox_2d": [450.0, 88.0, 475.0, 114.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 476.0, 34.0], "label": "sperm"}, {"bbox_2d": [505.0, 22.0, 531.0, 49.0], "label": "sperm"}, {"bbox_2d": [388.0, 76.0, 436.0, 124.0], "label": "sperm"}, {"bbox_2d": [552.0, 201.0, 578.0, 230.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [600.0, 231.0, 631.0, 264.0], "label": "sperm"}, {"bbox_2d": [608.0, 281.0, 639.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [61.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 37.0, 640.0, 68.0], "label": "sperm"}, {"bbox_2d": [604.0, 348.0, 640.0, 393.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 193.0, 600.0, 221.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 427.0, 516.0, 446.0], "label": "sperm"}]
```


[User] <image> Can you see any normal sperm in the image? How many are there?

[Assistant]
```json
{"count": 27, "label": "normal sperm"}
```


[User] <image> Point out every normal sperm you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 27, "point_2d": [[233.5, 42.5], [264.5, 10.0], [173.0, 32.0], [167.0, 38.5], [155.0, 56.5], [98.0, 74.0], [93.0, 169.0], [105.5, 194.0], [142.5, 254.0], [268.0, 331.5], [359.0, 367.5], [462.5, 101.0], [462.5, 19.5], [518.0, 35.5], [412.0, 100.0], [565.0, 215.5], [555.5, 249.0], [615.5, 247.5], [623.5, 299.0], [552.5, 446.0], [77.5, 467.5], [630.5, 52.5], [622.0, 370.5], [135.5, 79.0], [587.0, 207.0], [608.5, 293.0], [505.5, 436.5]], "label": "normal sperm"}
```


[User] <image> Detect all normal sperm in the image with bounding boxes, and then output their count.

[Assistant]
```json
{"count": 27, "bbox_2d": [[222.0, 31.0, 245.0, 54.0], [253.0, 0.0, 276.0, 20.0], [162.0, 19.0, 184.0, 45.0], [156.0, 27.0, 178.0, 50.0], [141.0, 44.0, 169.0, 69.0], [86.0, 60.0, 110.0, 88.0], [80.0, 156.0, 106.0, 182.0], [92.0, 178.0, 119.0, 210.0], [121.0, 231.0, 164.0, 277.0], [253.0, 315.0, 283.0, 348.0], [345.0, 353.0, 373.0, 382.0], [450.0, 88.0, 475.0, 114.0], [449.0, 5.0, 476.0, 34.0], [505.0, 22.0, 531.0, 49.0], [388.0, 76.0, 436.0, 124.0], [552.0, 201.0, 578.0, 230.0], [541.0, 233.0, 570.0, 265.0], [600.0, 231.0, 631.0, 264.0], [608.0, 281.0, 639.0, 317.0], [538.0, 431.0, 567.0, 461.0], [61.0, 455.0, 94.0, 480.0], [621.0, 37.0, 640.0, 68.0], [604.0, 348.0, 640.0, 393.0], [121.0, 63.0, 150.0, 95.0], [574.0, 193.0, 600.0, 221.0], [596.0, 279.0, 621.0, 307.0], [495.0, 427.0, 516.0, 446.0]], "label": "normal sperm"}
```


[User] <image> Point out each pinhead in the image.

[Assistant]
```json
[{"point_2d": [19.5, 377.0], "label": "pinhead"}]
```


[User] <image> Outline the area containing pinhead by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [3.0, 359.0, 36.0, 395.0], "label": "pinhead"}]
```


[User] <image> How many pinhead sperm?

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Point out every pinhead you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 1, "point_2d": [[19.5, 377.0]], "label": "pinhead sperm"}
```


[User] <image> Find all pinhead in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 1, "bbox_2d": [[3.0, 359.0, 36.0, 395.0]], "label": "pinhead sperm"}
```


[User] <image> Show me where the clusters are

[Assistant]
```json
[{"point_2d": [576.0, 41.0], "label": "cluster"}, {"point_2d": [186.0, 107.5], "label": "cluster"}]
```


[User] <image> Generate bounding box coordinates for the cluster.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 611.0, 69.0], "label": "cluster"}, {"bbox_2d": [165.0, 91.0, 207.0, 124.0], "label": "cluster"}]
```


[User] <image> count cluster

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Mark each sperm cluster with a point, then output how many there are.

[Assistant]
```json
{"count": 2, "point_2d": [[576.0, 41.0], [186.0, 107.5]], "label": "cluster"}
```


[User] <image> Provide bounding box coordinates for each sperm cluster and then specify the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 611.0, 69.0], [165.0, 91.0, 207.0, 124.0]], "label": "cluster"}
```


[User] <image> If there is a normal sperm present, indicate its position.

[Assistant]
```json
[{"point_2d": [180.0, 57.5], "label": "normal sperm"}, {"point_2d": [265.0, 14.5], "label": "normal sperm"}, {"point_2d": [172.0, 32.5], "label": "normal sperm"}, {"point_2d": [166.0, 38.5], "label": "normal sperm"}, {"point_2d": [167.0, 47.5], "label": "normal sperm"}, {"point_2d": [99.0, 74.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [105.5, 193.0], "label": "normal sperm"}, {"point_2d": [105.0, 241.0], "label": "normal sperm"}, {"point_2d": [268.0, 331.5], "label": "normal sperm"}, {"point_2d": [359.0, 366.5], "label": "normal sperm"}, {"point_2d": [502.0, 126.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [518.0, 35.5], "label": "normal sperm"}, {"point_2d": [424.0, 115.0], "label": "normal sperm"}, {"point_2d": [565.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [611.5, 250.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [612.5, 329.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 206.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Locate and mark sperm with a bounding box.

[Assistant]
```json
[{"bbox_2d": [168.0, 46.0, 192.0, 69.0], "label": "sperm"}, {"bbox_2d": [250.0, 0.0, 280.0, 29.0], "label": "sperm"}, {"bbox_2d": [161.0, 20.0, 183.0, 45.0], "label": "sperm"}, {"bbox_2d": [155.0, 27.0, 177.0, 50.0], "label": "sperm"}, {"bbox_2d": [153.0, 35.0, 181.0, 60.0], "label": "sperm"}, {"bbox_2d": [87.0, 60.0, 111.0, 88.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "sperm"}, {"bbox_2d": [81.0, 217.0, 129.0, 265.0], "label": "sperm"}, {"bbox_2d": [253.0, 315.0, 283.0, 348.0], "label": "sperm"}, {"bbox_2d": [345.0, 352.0, 373.0, 381.0], "label": "sperm"}, {"bbox_2d": [489.0, 113.0, 515.0, 139.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [505.0, 22.0, 531.0, 49.0], "label": "sperm"}, {"bbox_2d": [400.0, 91.0, 448.0, 139.0], "label": "sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [596.0, 234.0, 627.0, 267.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [592.0, 307.0, 633.0, 352.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 192.0, 600.0, 220.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> How many normal sperm?

[Assistant]
```json
{"count": 27, "label": "normal sperm"}
```


[User] <image> Point to and count the normal sperm in the picture.

[Assistant]
```json
{"count": 27, "point_2d": [[180.0, 57.5], [265.0, 14.5], [172.0, 32.5], [166.0, 38.5], [167.0, 47.5], [99.0, 74.0], [93.0, 169.0], [105.5, 193.0], [105.0, 241.0], [268.0, 331.5], [359.0, 366.5], [502.0, 126.0], [463.0, 19.5], [518.0, 35.5], [424.0, 115.0], [565.0, 214.5], [555.5, 249.0], [611.5, 250.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [612.5, 329.5], [135.5, 79.0], [587.0, 206.0], [608.5, 293.0], [505.5, 435.5]], "label": "normal sperm"}
```


[User] <image> Count all normal sperm in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 27, "bbox_2d": [[168.0, 46.0, 192.0, 69.0], [250.0, 0.0, 280.0, 29.0], [161.0, 20.0, 183.0, 45.0], [155.0, 27.0, 177.0, 50.0], [153.0, 35.0, 181.0, 60.0], [87.0, 60.0, 111.0, 88.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [81.0, 217.0, 129.0, 265.0], [253.0, 315.0, 283.0, 348.0], [345.0, 352.0, 373.0, 381.0], [489.0, 113.0, 515.0, 139.0], [449.0, 5.0, 477.0, 34.0], [505.0, 22.0, 531.0, 49.0], [400.0, 91.0, 448.0, 139.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [596.0, 234.0, 627.0, 267.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [592.0, 307.0, 633.0, 352.0], [121.0, 63.0, 150.0, 95.0], [574.0, 192.0, 600.0, 220.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "normal sperm"}
```


[User] <image> show me all visible pinhead sperms

[Assistant]
```json
[{"point_2d": [28.0, 377.0], "label": "pinhead sperm"}]
```


[User] <image> Locate the pinhead sperm and mark it with a bounding box in the image.

[Assistant]
```json
[{"bbox_2d": [12.0, 359.0, 44.0, 395.0], "label": "pinhead sperm"}]
```


[User] <image> Count every pinhead in the picture.

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Locate the pinhead sperm and count them, then point to them.

[Assistant]
```json
{"count": 1, "point_2d": [[28.0, 377.0]], "label": "pinhead"}
```


[User] <image> Provide bounding box coordinates for each pinhead sperm and then specify the total count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[12.0, 359.0, 44.0, 395.0]], "label": "pinhead"}
```


[User] <image> Locate a sperm cluster.

[Assistant]
```json
[{"point_2d": [576.0, 41.0], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Return the rectangular bounding box that covers cluster in the image.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 611.0, 69.0], "label": "cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "cluster"}]
```


[User] <image> how mmny sperm cluster?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Point to each instance of sperm cluster and then output their total number.

[Assistant]
```json
{"count": 2, "point_2d": [[576.0, 41.0], [186.0, 106.5]], "label": "sperm cluster"}
```


[User] <image> Mark each sperm cluster with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 611.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "sperm cluster"}
```


[User] <image> Show me where a normal sperm is.

[Assistant]
```json
[{"point_2d": [155.0, 70.5], "label": "normal sperm"}, {"point_2d": [265.0, 17.5], "label": "normal sperm"}, {"point_2d": [172.0, 33.5], "label": "normal sperm"}, {"point_2d": [165.0, 40.5], "label": "normal sperm"}, {"point_2d": [170.0, 64.5], "label": "normal sperm"}, {"point_2d": [102.5, 71.5], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [105.5, 193.0], "label": "normal sperm"}, {"point_2d": [89.0, 233.0], "label": "normal sperm"}, {"point_2d": [271.0, 331.5], "label": "normal sperm"}, {"point_2d": [362.0, 365.5], "label": "normal sperm"}, {"point_2d": [528.0, 140.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [519.0, 35.5], "label": "normal sperm"}, {"point_2d": [430.0, 125.0], "label": "normal sperm"}, {"point_2d": [565.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [592.5, 321.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 205.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Return the rectangular bounding box that covers sperm in the image.

[Assistant]
```json
[{"bbox_2d": [143.0, 59.0, 167.0, 82.0], "label": "sperm"}, {"bbox_2d": [250.0, 3.0, 280.0, 32.0], "label": "sperm"}, {"bbox_2d": [161.0, 21.0, 183.0, 46.0], "label": "sperm"}, {"bbox_2d": [154.0, 29.0, 176.0, 52.0], "label": "sperm"}, {"bbox_2d": [156.0, 52.0, 184.0, 77.0], "label": "sperm"}, {"bbox_2d": [89.0, 57.0, 116.0, 86.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "sperm"}, {"bbox_2d": [65.0, 209.0, 113.0, 257.0], "label": "sperm"}, {"bbox_2d": [256.0, 315.0, 286.0, 348.0], "label": "sperm"}, {"bbox_2d": [348.0, 351.0, 376.0, 380.0], "label": "sperm"}, {"bbox_2d": [515.0, 127.0, 541.0, 153.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [506.0, 22.0, 532.0, 49.0], "label": "sperm"}, {"bbox_2d": [406.0, 101.0, 454.0, 149.0], "label": "sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [572.0, 299.0, 613.0, 344.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 191.0, 600.0, 219.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> In all the picture, how many normal sperm are there?

[Assistant]
```json
{"count": 27, "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a point, then output how many there are.

[Assistant]
```json
{"count": 27, "point_2d": [[155.0, 70.5], [265.0, 17.5], [172.0, 33.5], [165.0, 40.5], [170.0, 64.5], [102.5, 71.5], [93.0, 169.0], [105.5, 193.0], [89.0, 233.0], [271.0, 331.5], [362.0, 365.5], [528.0, 140.0], [463.0, 19.5], [519.0, 35.5], [430.0, 125.0], [565.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [592.5, 321.5], [135.5, 79.0], [587.0, 205.0], [608.5, 293.0], [505.5, 435.5]], "label": "normal sperm"}
```


[User] <image> Outline all instances of normal sperm with bounding boxes, then return the count.

[Assistant]
```json
{"count": 27, "bbox_2d": [[143.0, 59.0, 167.0, 82.0], [250.0, 3.0, 280.0, 32.0], [161.0, 21.0, 183.0, 46.0], [154.0, 29.0, 176.0, 52.0], [156.0, 52.0, 184.0, 77.0], [89.0, 57.0, 116.0, 86.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [65.0, 209.0, 113.0, 257.0], [256.0, 315.0, 286.0, 348.0], [348.0, 351.0, 376.0, 380.0], [515.0, 127.0, 541.0, 153.0], [449.0, 5.0, 477.0, 34.0], [506.0, 22.0, 532.0, 49.0], [406.0, 101.0, 454.0, 149.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [572.0, 299.0, 613.0, 344.0], [121.0, 63.0, 150.0, 95.0], [574.0, 191.0, 600.0, 219.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "normal sperm"}
```


[User] <image> Find any pinheads in the picture

[Assistant]
```json
[{"point_2d": [30.0, 376.0], "label": "pinhead"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the pinhead sperm.

[Assistant]
```json
[{"bbox_2d": [14.0, 358.0, 46.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> Find each pinhead sperm. How many are there?

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Find each pinhead. How many are there? Point to them.

[Assistant]
```json
{"count": 1, "point_2d": [[30.0, 376.0]], "label": "pinhead sperm"}
```


[User] <image> Detect all pinhead in the image with bounding boxes, and then output their count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[14.0, 358.0, 46.0, 394.0]], "label": "pinhead sperm"}
```


[User] <image> I am looking for sperm clusters. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [576.5, 41.0], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Find the region corresponding to sperm cluster and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 612.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> What is the total number of sperm cluster in the image?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Find all the sperm cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[576.5, 41.0], [186.0, 106.5]], "label": "sperm cluster"}
```


[User] <image> Identify all sperm cluster in the image, count them, and provide bounding box coordinates for each.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 612.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "sperm cluster"}
```


[User]
<image> Point to sperm.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
[{"point_2d": [122.0, 67.5], "label": "sperm"}, {"point_2d": [266.0, 20.5], "label": "sperm"}, {"point_2d": [171.5, 34.5], "label": "sperm"}, {"point_2d": [163.0, 41.5], "label": "sperm"}, {"point_2d": [164.0, 66.5], "label": "sperm"}, {"point_2d": [102.5, 71.0], "label": "sperm"}, {"point_2d": [93.0, 169.0], "label": "sperm"}, {"point_2d": [106.5, 193.0], "label": "sperm"}, {"point_2d": [69.0, 234.0], "label": "sperm"}, {"point_2d": [272.0, 332.5], "label": "sperm"}, {"point_2d": [363.0, 365.5], "label": "sperm"}, {"point_2d": [548.0, 150.0], "label": "sperm"}, {"point_2d": [463.0, 19.5], "label": "sperm"}, {"point_2d": [520.0, 35.5], "label": "sperm"}, {"point_2d": [440.0, 133.0], "label": "sperm"}, {"point_2d": [566.0, 214.5], "label": "sperm"}, {"point_2d": [556.5, 249.0], "label": "sperm"}, {"point_2d": [610.5, 251.5], "label": "sperm"}, {"point_2d": [622.5, 299.5], "label": "sperm"}, {"point_2d": [552.5, 446.0], "label": "sperm"}, {"point_2d": [78.0, 467.5], "label": "sperm"}, {"point_2d": [630.5, 51.5], "label": "sperm"}, {"point_2d": [574.5, 308.5], "label": "sperm"}, {"point_2d": [135.5, 79.0], "label": "sperm"}, {"point_2d": [587.0, 204.0], "label": "sperm"}, {"point_2d": [608.5, 293.0], "label": "sperm"}, {"point_2d": [505.5, 435.5], "label": "sperm"}]
```


[User] <image> Return the bounding box of the normal sperm.

[Assistant]
```json
[{"bbox_2d": [110.0, 56.0, 134.0, 79.0], "label": "normal sperm"}, {"bbox_2d": [251.0, 6.0, 281.0, 35.0], "label": "normal sperm"}, {"bbox_2d": [160.0, 22.0, 183.0, 47.0], "label": "normal sperm"}, {"bbox_2d": [152.0, 30.0, 174.0, 53.0], "label": "normal sperm"}, {"bbox_2d": [150.0, 54.0, 178.0, 79.0], "label": "normal sperm"}, {"bbox_2d": [89.0, 57.0, 116.0, 85.0], "label": "normal sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "normal sperm"}, {"bbox_2d": [93.0, 177.0, 120.0, 209.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 210.0, 93.0, 258.0], "label": "normal sperm"}, {"bbox_2d": [257.0, 316.0, 287.0, 349.0], "label": "normal sperm"}, {"bbox_2d": [349.0, 351.0, 377.0, 380.0], "label": "normal sperm"}, {"bbox_2d": [535.0, 137.0, 561.0, 163.0], "label": "normal sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "normal sperm"}, {"bbox_2d": [507.0, 22.0, 533.0, 49.0], "label": "normal sperm"}, {"bbox_2d": [416.0, 109.0, 464.0, 157.0], "label": "normal sperm"}, {"bbox_2d": [553.0, 200.0, 579.0, 229.0], "label": "normal sperm"}, {"bbox_2d": [542.0, 233.0, 571.0, 265.0], "label": "normal sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "normal sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "normal sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "normal sperm"}, {"bbox_2d": [554.0, 286.0, 595.0, 331.0], "label": "normal sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "normal sperm"}, {"bbox_2d": [574.0, 190.0, 600.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "normal sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "normal sperm"}]
```


[User] <image> Where are the normal sperm? How many are there?

[Assistant]
```json
{"count": 27, "label": "normal sperm"}
```


[User] <image> Identify all occurrences of sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 27, "point_2d": [[122.0, 67.5], [266.0, 20.5], [171.5, 34.5], [163.0, 41.5], [164.0, 66.5], [102.5, 71.0], [93.0, 169.0], [106.5, 193.0], [69.0, 234.0], [272.0, 332.5], [363.0, 365.5], [548.0, 150.0], [463.0, 19.5], [520.0, 35.5], [440.0, 133.0], [566.0, 214.5], [556.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [574.5, 308.5], [135.5, 79.0], [587.0, 204.0], [608.5, 293.0], [505.5, 435.5]], "label": "normal sperm"}
```


[User] <image> Mark all sperm with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 27, "bbox_2d": [[110.0, 56.0, 134.0, 79.0], [251.0, 6.0, 281.0, 35.0], [160.0, 22.0, 183.0, 47.0], [152.0, 30.0, 174.0, 53.0], [150.0, 54.0, 178.0, 79.0], [89.0, 57.0, 116.0, 85.0], [80.0, 156.0, 106.0, 182.0], [93.0, 177.0, 120.0, 209.0], [45.0, 210.0, 93.0, 258.0], [257.0, 316.0, 287.0, 349.0], [349.0, 351.0, 377.0, 380.0], [535.0, 137.0, 561.0, 163.0], [449.0, 5.0, 477.0, 34.0], [507.0, 22.0, 533.0, 49.0], [416.0, 109.0, 464.0, 157.0], [553.0, 200.0, 579.0, 229.0], [542.0, 233.0, 571.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [554.0, 286.0, 595.0, 331.0], [121.0, 63.0, 150.0, 95.0], [574.0, 190.0, 600.0, 218.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "normal sperm"}
```


[User] <image> Please find pinheads and show me where they are.

[Assistant]
```json
[{"point_2d": [31.0, 376.0], "label": "pinhead"}]
```


[User] <image> Return a bounding box that encloses pinhead.

[Assistant]
```json
[{"bbox_2d": [15.0, 358.0, 47.0, 394.0], "label": "pinhead"}]
```


[User] <image> How many pinhead are there in the image?

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Indicate each pinhead in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 1, "point_2d": [[31.0, 376.0]], "label": "pinhead"}
```


[User] <image> Provide the total number of pinhead and for each, supply a bounding box.

[Assistant]
```json
{"count": 1, "bbox_2d": [[15.0, 358.0, 47.0, 394.0]], "label": "pinhead"}
```


[User] <image> Find the sperm cluster.

[Assistant]
```json
[{"point_2d": [577.0, 41.0], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Find the sperm cluster in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 613.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> How many sperm cluster are visible?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Count the sperm cluster in the image, then point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[577.0, 41.0], [186.0, 106.5]], "label": "sperm cluster"}
```


[User] <image> Provide bounding box coordinates for each sperm cluster and then specify the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 613.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "sperm cluster"}
```


[User]
<image> Object: normal sperm
Instruction: Point to the object.

[Assistant]
```json
[{"point_2d": [139.0, 69.5], "label": "normal sperm"}, {"point_2d": [265.0, 19.5], "label": "normal sperm"}, {"point_2d": [171.5, 34.5], "label": "normal sperm"}, {"point_2d": [164.0, 40.5], "label": "normal sperm"}, {"point_2d": [164.0, 67.5], "label": "normal sperm"}, {"point_2d": [102.5, 71.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [105.5, 193.0], "label": "normal sperm"}, {"point_2d": [73.0, 236.0], "label": "normal sperm"}, {"point_2d": [272.0, 332.5], "label": "normal sperm"}, {"point_2d": [363.0, 365.5], "label": "normal sperm"}, {"point_2d": [537.0, 148.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [519.0, 35.5], "label": "normal sperm"}, {"point_2d": [435.0, 128.0], "label": "normal sperm"}, {"point_2d": [565.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [582.5, 313.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 205.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Outline the area containing sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [127.0, 58.0, 151.0, 81.0], "label": "sperm"}, {"bbox_2d": [250.0, 5.0, 280.0, 34.0], "label": "sperm"}, {"bbox_2d": [160.0, 22.0, 183.0, 47.0], "label": "sperm"}, {"bbox_2d": [153.0, 29.0, 175.0, 52.0], "label": "sperm"}, {"bbox_2d": [150.0, 55.0, 178.0, 80.0], "label": "sperm"}, {"bbox_2d": [89.0, 57.0, 116.0, 85.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "sperm"}, {"bbox_2d": [49.0, 212.0, 97.0, 260.0], "label": "sperm"}, {"bbox_2d": [257.0, 316.0, 287.0, 349.0], "label": "sperm"}, {"bbox_2d": [349.0, 351.0, 377.0, 380.0], "label": "sperm"}, {"bbox_2d": [524.0, 135.0, 550.0, 161.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [506.0, 22.0, 532.0, 49.0], "label": "sperm"}, {"bbox_2d": [411.0, 104.0, 459.0, 152.0], "label": "sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [562.0, 291.0, 603.0, 336.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 191.0, 600.0, 219.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> Can you point out all sperm in this image? How many are there?

[Assistant]
```json
{"count": 27, "label": "sperm"}
```


[User] <image> Point out every normal sperm you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 27, "point_2d": [[139.0, 69.5], [265.0, 19.5], [171.5, 34.5], [164.0, 40.5], [164.0, 67.5], [102.5, 71.0], [93.0, 169.0], [105.5, 193.0], [73.0, 236.0], [272.0, 332.5], [363.0, 365.5], [537.0, 148.0], [463.0, 19.5], [519.0, 35.5], [435.0, 128.0], [565.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [582.5, 313.5], [135.5, 79.0], [587.0, 205.0], [608.5, 293.0], [505.5, 435.5]], "label": "sperm"}
```


[User] <image> Return bounding boxes for each normal sperm in the image and the total count.

[Assistant]
```json
{"count": 27, "bbox_2d": [[127.0, 58.0, 151.0, 81.0], [250.0, 5.0, 280.0, 34.0], [160.0, 22.0, 183.0, 47.0], [153.0, 29.0, 175.0, 52.0], [150.0, 55.0, 178.0, 80.0], [89.0, 57.0, 116.0, 85.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [49.0, 212.0, 97.0, 260.0], [257.0, 316.0, 287.0, 349.0], [349.0, 351.0, 377.0, 380.0], [524.0, 135.0, 550.0, 161.0], [449.0, 5.0, 477.0, 34.0], [506.0, 22.0, 532.0, 49.0], [411.0, 104.0, 459.0, 152.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [562.0, 291.0, 603.0, 336.0], [121.0, 63.0, 150.0, 95.0], [574.0, 191.0, 600.0, 219.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "sperm"}
```


[User] <image> Locate all pinhead sperms.

[Assistant]
```json
[{"point_2d": [30.0, 376.0], "label": "pinhead sperm"}]
```


[User] <image> Provide a bounding box that tightly encloses the pinhead sperm.

[Assistant]
```json
[{"bbox_2d": [14.0, 358.0, 46.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> how many pinhead

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> How many pinhead are there? Point to them.

[Assistant]
```json
{"count": 1, "point_2d": [[30.0, 376.0]], "label": "pinhead"}
```


[User] <image> Draw bounding boxes around every pinhead and then provide the total count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[14.0, 358.0, 46.0, 394.0]], "label": "pinhead"}
```


[User] <image> Locate each sperm cluster in the image.

[Assistant]
```json
[{"point_2d": [576.5, 41.0], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Draw a bounding box around sperm cluster.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 612.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> Count each cluster

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> How many sperm cluster are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[576.5, 41.0], [186.0, 106.5]], "label": "cluster"}
```


[User] <image> Find all sperm cluster in the image, draw bounding boxes around them, and then count them.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 612.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "cluster"}
```


[User] <image> Generate a list of points showing where the normal sperms are.

[Assistant]
```json
[{"point_2d": [132.0, 72.5], "label": "normal sperm"}, {"point_2d": [265.0, 19.5], "label": "normal sperm"}, {"point_2d": [171.5, 34.5], "label": "normal sperm"}, {"point_2d": [164.0, 41.5], "label": "normal sperm"}, {"point_2d": [164.0, 67.5], "label": "normal sperm"}, {"point_2d": [102.5, 71.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [106.5, 193.0], "label": "normal sperm"}, {"point_2d": [68.0, 239.0], "label": "normal sperm"}, {"point_2d": [272.0, 332.5], "label": "normal sperm"}, {"point_2d": [363.0, 365.5], "label": "normal sperm"}, {"point_2d": [542.0, 148.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [519.0, 35.5], "label": "normal sperm"}, {"point_2d": [440.0, 128.0], "label": "normal sperm"}, {"point_2d": [566.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [578.5, 310.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 204.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Mark the object sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [120.0, 61.0, 144.0, 84.0], "label": "sperm"}, {"bbox_2d": [250.0, 5.0, 280.0, 34.0], "label": "sperm"}, {"bbox_2d": [160.0, 22.0, 183.0, 47.0], "label": "sperm"}, {"bbox_2d": [153.0, 30.0, 175.0, 53.0], "label": "sperm"}, {"bbox_2d": [150.0, 55.0, 178.0, 80.0], "label": "sperm"}, {"bbox_2d": [89.0, 57.0, 116.0, 85.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [93.0, 177.0, 120.0, 209.0], "label": "sperm"}, {"bbox_2d": [44.0, 215.0, 92.0, 263.0], "label": "sperm"}, {"bbox_2d": [257.0, 316.0, 287.0, 349.0], "label": "sperm"}, {"bbox_2d": [349.0, 351.0, 377.0, 380.0], "label": "sperm"}, {"bbox_2d": [529.0, 135.0, 555.0, 161.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [506.0, 22.0, 532.0, 49.0], "label": "sperm"}, {"bbox_2d": [416.0, 104.0, 464.0, 152.0], "label": "sperm"}, {"bbox_2d": [553.0, 200.0, 579.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [558.0, 288.0, 599.0, 333.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 190.0, 600.0, 218.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> Can you count the number of sperm in the image?

[Assistant]
```json
{"count": 27, "label": "sperm"}
```


[User] <image> Point to all normal sperm in the image and then count them.

[Assistant]
```json
{"count": 27, "point_2d": [[132.0, 72.5], [265.0, 19.5], [171.5, 34.5], [164.0, 41.5], [164.0, 67.5], [102.5, 71.0], [93.0, 169.0], [106.5, 193.0], [68.0, 239.0], [272.0, 332.5], [363.0, 365.5], [542.0, 148.0], [463.0, 19.5], [519.0, 35.5], [440.0, 128.0], [566.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [578.5, 310.5], [135.5, 79.0], [587.0, 204.0], [608.5, 293.0], [505.5, 435.5]], "label": "sperm"}
```


[User] <image> Outline all instances of normal sperm with bounding boxes, then return the count.

[Assistant]
```json
{"count": 27, "bbox_2d": [[120.0, 61.0, 144.0, 84.0], [250.0, 5.0, 280.0, 34.0], [160.0, 22.0, 183.0, 47.0], [153.0, 30.0, 175.0, 53.0], [150.0, 55.0, 178.0, 80.0], [89.0, 57.0, 116.0, 85.0], [80.0, 156.0, 106.0, 182.0], [93.0, 177.0, 120.0, 209.0], [44.0, 215.0, 92.0, 263.0], [257.0, 316.0, 287.0, 349.0], [349.0, 351.0, 377.0, 380.0], [529.0, 135.0, 555.0, 161.0], [449.0, 5.0, 477.0, 34.0], [506.0, 22.0, 532.0, 49.0], [416.0, 104.0, 464.0, 152.0], [553.0, 200.0, 579.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [558.0, 288.0, 599.0, 333.0], [121.0, 63.0, 150.0, 95.0], [574.0, 190.0, 600.0, 218.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "sperm"}
```


[User]
<image> Object: pinhead sperm
Instruction: Point to the object.

[Assistant]
```json
[{"point_2d": [31.0, 376.0], "label": "pinhead sperm"}]
```


[User] <image> Find the pinhead sperm in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [15.0, 358.0, 47.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> Locate every pinhead and count them

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Count every pinhead sperm in the picture, then point to them.

[Assistant]
```json
{"count": 1, "point_2d": [[31.0, 376.0]], "label": "pinhead"}
```


[User] <image> Detect all pinhead sperm in the image with bounding boxes, and then output their count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[15.0, 358.0, 47.0, 394.0]], "label": "pinhead"}
```


[User] <image> Show me where the clusters are

[Assistant]
```json
[{"point_2d": [576.5, 41.0], "label": "cluster"}, {"point_2d": [186.0, 106.5], "label": "cluster"}]
```


[User] <image> Outline the area containing sperm cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 612.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> Point to all the visible cluster output the total count.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Find all the cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[576.5, 41.0], [186.0, 106.5]], "label": "cluster"}
```


[User] <image> Return both the count and the bounding boxes of all cluster in the image.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 612.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "cluster"}
```


[User] <image> Point: Where are the sperms?

[Assistant]
```json
[{"point_2d": [130.0, 73.5], "label": "sperm"}, {"point_2d": [265.0, 19.5], "label": "sperm"}, {"point_2d": [171.5, 34.5], "label": "sperm"}, {"point_2d": [164.0, 41.5], "label": "sperm"}, {"point_2d": [164.0, 67.5], "label": "sperm"}, {"point_2d": [102.5, 71.0], "label": "sperm"}, {"point_2d": [93.0, 169.0], "label": "sperm"}, {"point_2d": [106.5, 193.0], "label": "sperm"}, {"point_2d": [67.0, 240.0], "label": "sperm"}, {"point_2d": [272.0, 332.5], "label": "sperm"}, {"point_2d": [363.0, 365.5], "label": "sperm"}, {"point_2d": [543.0, 148.0], "label": "sperm"}, {"point_2d": [463.0, 19.5], "label": "sperm"}, {"point_2d": [519.0, 35.5], "label": "sperm"}, {"point_2d": [441.0, 128.0], "label": "sperm"}, {"point_2d": [566.0, 214.5], "label": "sperm"}, {"point_2d": [555.5, 249.0], "label": "sperm"}, {"point_2d": [610.5, 251.5], "label": "sperm"}, {"point_2d": [622.5, 299.5], "label": "sperm"}, {"point_2d": [552.5, 446.0], "label": "sperm"}, {"point_2d": [78.0, 467.5], "label": "sperm"}, {"point_2d": [630.5, 51.5], "label": "sperm"}, {"point_2d": [577.5, 309.5], "label": "sperm"}, {"point_2d": [135.5, 79.0], "label": "sperm"}, {"point_2d": [587.0, 204.0], "label": "sperm"}, {"point_2d": [608.5, 293.0], "label": "sperm"}, {"point_2d": [505.5, 435.5], "label": "sperm"}]
```


[User] <image> Outline the normal sperm using a bounding box.

[Assistant]
```json
[{"bbox_2d": [118.0, 62.0, 142.0, 85.0], "label": "normal sperm"}, {"bbox_2d": [250.0, 5.0, 280.0, 34.0], "label": "normal sperm"}, {"bbox_2d": [160.0, 22.0, 183.0, 47.0], "label": "normal sperm"}, {"bbox_2d": [153.0, 30.0, 175.0, 53.0], "label": "normal sperm"}, {"bbox_2d": [150.0, 55.0, 178.0, 80.0], "label": "normal sperm"}, {"bbox_2d": [89.0, 57.0, 116.0, 85.0], "label": "normal sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "normal sperm"}, {"bbox_2d": [93.0, 177.0, 120.0, 209.0], "label": "normal sperm"}, {"bbox_2d": [43.0, 216.0, 91.0, 264.0], "label": "normal sperm"}, {"bbox_2d": [257.0, 316.0, 287.0, 349.0], "label": "normal sperm"}, {"bbox_2d": [349.0, 351.0, 377.0, 380.0], "label": "normal sperm"}, {"bbox_2d": [530.0, 135.0, 556.0, 161.0], "label": "normal sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "normal sperm"}, {"bbox_2d": [506.0, 22.0, 532.0, 49.0], "label": "normal sperm"}, {"bbox_2d": [417.0, 104.0, 465.0, 152.0], "label": "normal sperm"}, {"bbox_2d": [553.0, 200.0, 579.0, 229.0], "label": "normal sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "normal sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "normal sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "normal sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "normal sperm"}, {"bbox_2d": [557.0, 287.0, 598.0, 332.0], "label": "normal sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "normal sperm"}, {"bbox_2d": [574.0, 190.0, 600.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "normal sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "normal sperm"}]
```


[User] <image> Locate every normal sperm and count them

[Assistant]
```json
{"count": 27, "label": "normal sperm"}
```


[User] <image> Count every normal sperm in the picture, then point to them.

[Assistant]
```json
{"count": 27, "point_2d": [[130.0, 73.5], [265.0, 19.5], [171.5, 34.5], [164.0, 41.5], [164.0, 67.5], [102.5, 71.0], [93.0, 169.0], [106.5, 193.0], [67.0, 240.0], [272.0, 332.5], [363.0, 365.5], [543.0, 148.0], [463.0, 19.5], [519.0, 35.5], [441.0, 128.0], [566.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [577.5, 309.5], [135.5, 79.0], [587.0, 204.0], [608.5, 293.0], [505.5, 435.5]], "label": "normal sperm"}
```


[User] <image> Provide the total number of normal sperm and for each, supply a bounding box.

[Assistant]
```json
{"count": 27, "bbox_2d": [[118.0, 62.0, 142.0, 85.0], [250.0, 5.0, 280.0, 34.0], [160.0, 22.0, 183.0, 47.0], [153.0, 30.0, 175.0, 53.0], [150.0, 55.0, 178.0, 80.0], [89.0, 57.0, 116.0, 85.0], [80.0, 156.0, 106.0, 182.0], [93.0, 177.0, 120.0, 209.0], [43.0, 216.0, 91.0, 264.0], [257.0, 316.0, 287.0, 349.0], [349.0, 351.0, 377.0, 380.0], [530.0, 135.0, 556.0, 161.0], [449.0, 5.0, 477.0, 34.0], [506.0, 22.0, 532.0, 49.0], [417.0, 104.0, 465.0, 152.0], [553.0, 200.0, 579.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [557.0, 287.0, 598.0, 332.0], [121.0, 63.0, 150.0, 95.0], [574.0, 190.0, 600.0, 218.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "normal sperm"}
```


[User] <image> Locate each pinhead sperm in the image.

[Assistant]
```json
[{"point_2d": [31.0, 376.0], "label": "pinhead sperm"}]
```


[User] <image> Outline the area containing pinhead sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [15.0, 358.0, 47.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> How many pinhead sperm are there in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Indicate each pinhead sperm in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 1, "point_2d": [[31.0, 376.0]], "label": "pinhead sperm"}
```


[User] <image> Count the pinhead sperm and enclose each in a bounding box.

[Assistant]
```json
{"count": 1, "bbox_2d": [[15.0, 358.0, 47.0, 394.0]], "label": "pinhead sperm"}
```


[User] <image> Show me where a cluster is.

[Assistant]
```json
[{"point_2d": [576.5, 40.5], "label": "cluster"}, {"point_2d": [186.0, 106.5], "label": "cluster"}]
```


[User] <image> Mark the object cluster with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [541.0, 12.0, 612.0, 69.0], "label": "cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "cluster"}]
```


[User] <image> Locate the sperm cluster and count them

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Count the sperm cluster in the image, then point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[576.5, 40.5], [186.0, 106.5]], "label": "sperm cluster"}
```


[User] <image> Provide bounding box coordinates for each sperm cluster and then specify the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 12.0, 612.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "sperm cluster"}
```


[User] <image> Find any sperms in the picture

[Assistant]
```json
[{"point_2d": [168.0, 65.5], "label": "sperm"}, {"point_2d": [265.0, 16.5], "label": "sperm"}, {"point_2d": [172.0, 33.5], "label": "sperm"}, {"point_2d": [165.0, 39.5], "label": "sperm"}, {"point_2d": [170.0, 57.5], "label": "sperm"}, {"point_2d": [101.0, 73.0], "label": "sperm"}, {"point_2d": [93.0, 169.0], "label": "sperm"}, {"point_2d": [105.5, 193.0], "label": "sperm"}, {"point_2d": [96.0, 236.0], "label": "sperm"}, {"point_2d": [270.0, 331.5], "label": "sperm"}, {"point_2d": [361.0, 365.5], "label": "sperm"}, {"point_2d": [511.0, 129.0], "label": "sperm"}, {"point_2d": [463.0, 19.5], "label": "sperm"}, {"point_2d": [518.0, 35.5], "label": "sperm"}, {"point_2d": [427.0, 119.0], "label": "sperm"}, {"point_2d": [565.0, 214.5], "label": "sperm"}, {"point_2d": [555.5, 249.0], "label": "sperm"}, {"point_2d": [610.5, 251.5], "label": "sperm"}, {"point_2d": [622.5, 299.5], "label": "sperm"}, {"point_2d": [552.5, 446.0], "label": "sperm"}, {"point_2d": [78.0, 467.5], "label": "sperm"}, {"point_2d": [630.5, 51.5], "label": "sperm"}, {"point_2d": [600.5, 327.5], "label": "sperm"}, {"point_2d": [135.5, 79.0], "label": "sperm"}, {"point_2d": [587.0, 206.0], "label": "sperm"}, {"point_2d": [608.5, 293.0], "label": "sperm"}, {"point_2d": [505.5, 435.5], "label": "sperm"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [156.0, 54.0, 180.0, 77.0], "label": "sperm"}, {"bbox_2d": [250.0, 2.0, 280.0, 31.0], "label": "sperm"}, {"bbox_2d": [161.0, 21.0, 183.0, 46.0], "label": "sperm"}, {"bbox_2d": [154.0, 28.0, 176.0, 51.0], "label": "sperm"}, {"bbox_2d": [156.0, 45.0, 184.0, 70.0], "label": "sperm"}, {"bbox_2d": [89.0, 59.0, 113.0, 87.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "sperm"}, {"bbox_2d": [72.0, 212.0, 120.0, 260.0], "label": "sperm"}, {"bbox_2d": [255.0, 315.0, 285.0, 348.0], "label": "sperm"}, {"bbox_2d": [347.0, 351.0, 375.0, 380.0], "label": "sperm"}, {"bbox_2d": [498.0, 116.0, 524.0, 142.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [505.0, 22.0, 531.0, 49.0], "label": "sperm"}, {"bbox_2d": [403.0, 95.0, 451.0, 143.0], "label": "sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [580.0, 305.0, 621.0, 350.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 192.0, 600.0, 220.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> Count all the normal sperm

[Assistant]
```json
{"count": 27, "label": "normal sperm"}
```


[User] <image> Find all the sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 27, "point_2d": [[168.0, 65.5], [265.0, 16.5], [172.0, 33.5], [165.0, 39.5], [170.0, 57.5], [101.0, 73.0], [93.0, 169.0], [105.5, 193.0], [96.0, 236.0], [270.0, 331.5], [361.0, 365.5], [511.0, 129.0], [463.0, 19.5], [518.0, 35.5], [427.0, 119.0], [565.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [600.5, 327.5], [135.5, 79.0], [587.0, 206.0], [608.5, 293.0], [505.5, 435.5]], "label": "normal sperm"}
```


[User] <image> Count all sperm in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 27, "bbox_2d": [[156.0, 54.0, 180.0, 77.0], [250.0, 2.0, 280.0, 31.0], [161.0, 21.0, 183.0, 46.0], [154.0, 28.0, 176.0, 51.0], [156.0, 45.0, 184.0, 70.0], [89.0, 59.0, 113.0, 87.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [72.0, 212.0, 120.0, 260.0], [255.0, 315.0, 285.0, 348.0], [347.0, 351.0, 375.0, 380.0], [498.0, 116.0, 524.0, 142.0], [449.0, 5.0, 477.0, 34.0], [505.0, 22.0, 531.0, 49.0], [403.0, 95.0, 451.0, 143.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [580.0, 305.0, 621.0, 350.0], [121.0, 63.0, 150.0, 95.0], [574.0, 192.0, 600.0, 220.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "normal sperm"}
```


[User] <image> Can you show me where the pinheads are?

[Assistant]
```json
[{"point_2d": [29.0, 376.0], "label": "pinhead"}]
```


[User] <image> Return a bounding box that encloses pinhead sperm.

[Assistant]
```json
[{"bbox_2d": [13.0, 358.0, 45.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> find any pinhead in the picture and output the total count.

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Point out every pinhead you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 1, "point_2d": [[29.0, 376.0]], "label": "pinhead"}
```


[User] <image> Output a list of bounding boxes for every pinhead and the overall count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[13.0, 358.0, 45.0, 394.0]], "label": "pinhead"}
```


[User] <image> Where are the sperm clusters?

[Assistant]
```json
[{"point_2d": [576.0, 40.5], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Find the region corresponding to sperm cluster and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [541.0, 12.0, 611.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> Generate list of points showing where the sperm cluster are and output the total count.

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Mark all visible sperm cluster in the image with a point and then provide the count.

[Assistant]
```json
{"count": 2, "point_2d": [[576.0, 40.5], [186.0, 106.5]], "label": "sperm cluster"}
```


[User] <image> Draw bounding boxes around every sperm cluster and then provide the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 12.0, 611.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "sperm cluster"}
```


[User] <image> Find normal sperm.

[Assistant]
```json
[{"point_2d": [163.0, 67.5], "label": "normal sperm"}, {"point_2d": [265.0, 16.5], "label": "normal sperm"}, {"point_2d": [172.0, 33.5], "label": "normal sperm"}, {"point_2d": [165.0, 39.5], "label": "normal sperm"}, {"point_2d": [170.0, 60.5], "label": "normal sperm"}, {"point_2d": [101.5, 73.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [105.5, 193.0], "label": "normal sperm"}, {"point_2d": [93.0, 235.0], "label": "normal sperm"}, {"point_2d": [270.0, 331.5], "label": "normal sperm"}, {"point_2d": [361.0, 365.5], "label": "normal sperm"}, {"point_2d": [517.0, 132.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [518.0, 35.5], "label": "normal sperm"}, {"point_2d": [428.0, 121.0], "label": "normal sperm"}, {"point_2d": [565.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [597.5, 325.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 205.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Mark the normal sperm with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [151.0, 56.0, 175.0, 79.0], "label": "normal sperm"}, {"bbox_2d": [250.0, 2.0, 280.0, 31.0], "label": "normal sperm"}, {"bbox_2d": [161.0, 21.0, 183.0, 46.0], "label": "normal sperm"}, {"bbox_2d": [154.0, 28.0, 176.0, 51.0], "label": "normal sperm"}, {"bbox_2d": [156.0, 48.0, 184.0, 73.0], "label": "normal sperm"}, {"bbox_2d": [89.0, 59.0, 114.0, 87.0], "label": "normal sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "normal sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "normal sperm"}, {"bbox_2d": [69.0, 211.0, 117.0, 259.0], "label": "normal sperm"}, {"bbox_2d": [255.0, 315.0, 285.0, 348.0], "label": "normal sperm"}, {"bbox_2d": [347.0, 351.0, 375.0, 380.0], "label": "normal sperm"}, {"bbox_2d": [504.0, 119.0, 530.0, 145.0], "label": "normal sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "normal sperm"}, {"bbox_2d": [505.0, 22.0, 531.0, 49.0], "label": "normal sperm"}, {"bbox_2d": [404.0, 97.0, 452.0, 145.0], "label": "normal sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "normal sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "normal sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "normal sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "normal sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "normal sperm"}, {"bbox_2d": [577.0, 303.0, 618.0, 348.0], "label": "normal sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "normal sperm"}, {"bbox_2d": [574.0, 191.0, 600.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "normal sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "normal sperm"}]
```


[User] <image> how many sperm

[Assistant]
```json
{"count": 27, "label": "sperm"}
```


[User] <image> Point to and count the normal sperm in the picture.

[Assistant]
```json
{"count": 27, "point_2d": [[163.0, 67.5], [265.0, 16.5], [172.0, 33.5], [165.0, 39.5], [170.0, 60.5], [101.5, 73.0], [93.0, 169.0], [105.5, 193.0], [93.0, 235.0], [270.0, 331.5], [361.0, 365.5], [517.0, 132.0], [463.0, 19.5], [518.0, 35.5], [428.0, 121.0], [565.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [597.5, 325.5], [135.5, 79.0], [587.0, 205.0], [608.5, 293.0], [505.5, 435.5]], "label": "sperm"}
```


[User] <image> Count every normal sperm and return a list of bounding boxes.

[Assistant]
```json
{"count": 27, "bbox_2d": [[151.0, 56.0, 175.0, 79.0], [250.0, 2.0, 280.0, 31.0], [161.0, 21.0, 183.0, 46.0], [154.0, 28.0, 176.0, 51.0], [156.0, 48.0, 184.0, 73.0], [89.0, 59.0, 114.0, 87.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [69.0, 211.0, 117.0, 259.0], [255.0, 315.0, 285.0, 348.0], [347.0, 351.0, 375.0, 380.0], [504.0, 119.0, 530.0, 145.0], [449.0, 5.0, 477.0, 34.0], [505.0, 22.0, 531.0, 49.0], [404.0, 97.0, 452.0, 145.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [577.0, 303.0, 618.0, 348.0], [121.0, 63.0, 150.0, 95.0], [574.0, 191.0, 600.0, 219.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "sperm"}
```


[User] <image> Find pinhead sperm.

[Assistant]
```json
[{"point_2d": [29.0, 376.0], "label": "pinhead sperm"}]
```


[User] <image> Mark the object pinhead sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [13.0, 358.0, 45.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> How many pinhead are visible?

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Mark all visible pinhead sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 1, "point_2d": [[29.0, 376.0]], "label": "pinhead"}
```


[User] <image> Identify each pinhead sperm by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 1, "bbox_2d": [[13.0, 358.0, 45.0, 394.0]], "label": "pinhead"}
```


[User] <image> Locate cluster.

[Assistant]
```json
[{"point_2d": [576.0, 41.0], "label": "cluster"}, {"point_2d": [186.0, 106.5], "label": "cluster"}]
```


[User] <image> Identify cluster and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 611.0, 69.0], "label": "cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "cluster"}]
```


[User] <image> How many cluster are there in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Locate all cluster in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 2, "point_2d": [[576.0, 41.0], [186.0, 106.5]], "label": "cluster"}
```


[User] <image> Draw bounding boxes around every cluster and then provide the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 611.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "cluster"}
```


[User] <image> show me all visible normal sperms

[Assistant]
```json
[{"point_2d": [156.0, 69.5], "label": "normal sperm"}, {"point_2d": [265.0, 17.5], "label": "normal sperm"}, {"point_2d": [172.0, 33.5], "label": "normal sperm"}, {"point_2d": [165.0, 40.5], "label": "normal sperm"}, {"point_2d": [170.0, 64.5], "label": "normal sperm"}, {"point_2d": [102.0, 72.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [105.5, 193.0], "label": "normal sperm"}, {"point_2d": [89.0, 233.0], "label": "normal sperm"}, {"point_2d": [271.0, 331.5], "label": "normal sperm"}, {"point_2d": [362.0, 365.5], "label": "normal sperm"}, {"point_2d": [526.0, 138.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [519.0, 35.5], "label": "normal sperm"}, {"point_2d": [429.0, 124.0], "label": "normal sperm"}, {"point_2d": [565.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [592.5, 321.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 205.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Identify the sperm in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [144.0, 58.0, 168.0, 81.0], "label": "sperm"}, {"bbox_2d": [250.0, 3.0, 280.0, 32.0], "label": "sperm"}, {"bbox_2d": [161.0, 21.0, 183.0, 46.0], "label": "sperm"}, {"bbox_2d": [154.0, 29.0, 176.0, 52.0], "label": "sperm"}, {"bbox_2d": [156.0, 52.0, 184.0, 77.0], "label": "sperm"}, {"bbox_2d": [89.0, 58.0, 115.0, 86.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "sperm"}, {"bbox_2d": [65.0, 209.0, 113.0, 257.0], "label": "sperm"}, {"bbox_2d": [256.0, 315.0, 286.0, 348.0], "label": "sperm"}, {"bbox_2d": [348.0, 351.0, 376.0, 380.0], "label": "sperm"}, {"bbox_2d": [513.0, 125.0, 539.0, 151.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [506.0, 22.0, 532.0, 49.0], "label": "sperm"}, {"bbox_2d": [405.0, 100.0, 453.0, 148.0], "label": "sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [572.0, 299.0, 613.0, 344.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 191.0, 600.0, 219.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> Point to all occurrences of "sperm" and output the total count.

[Assistant]
```json
{"count": 27, "label": "sperm"}
```


[User] <image> Indicate the position of every sperm and provide the total count.

[Assistant]
```json
{"count": 27, "point_2d": [[156.0, 69.5], [265.0, 17.5], [172.0, 33.5], [165.0, 40.5], [170.0, 64.5], [102.0, 72.0], [93.0, 169.0], [105.5, 193.0], [89.0, 233.0], [271.0, 331.5], [362.0, 365.5], [526.0, 138.0], [463.0, 19.5], [519.0, 35.5], [429.0, 124.0], [565.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [592.5, 321.5], [135.5, 79.0], [587.0, 205.0], [608.5, 293.0], [505.5, 435.5]], "label": "sperm"}
```


[User] <image> Locate all instances of sperm, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 27, "bbox_2d": [[144.0, 58.0, 168.0, 81.0], [250.0, 3.0, 280.0, 32.0], [161.0, 21.0, 183.0, 46.0], [154.0, 29.0, 176.0, 52.0], [156.0, 52.0, 184.0, 77.0], [89.0, 58.0, 115.0, 86.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [65.0, 209.0, 113.0, 257.0], [256.0, 315.0, 286.0, 348.0], [348.0, 351.0, 376.0, 380.0], [513.0, 125.0, 539.0, 151.0], [449.0, 5.0, 477.0, 34.0], [506.0, 22.0, 532.0, 49.0], [405.0, 100.0, 453.0, 148.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [572.0, 299.0, 613.0, 344.0], [121.0, 63.0, 150.0, 95.0], [574.0, 191.0, 600.0, 219.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "sperm"}
```


[User] <image> I am looking for pinheads. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [30.0, 376.0], "label": "pinhead"}]
```


[User] <image> Enclose pinhead sperm in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [14.0, 358.0, 46.0, 394.0], "label": "pinhead sperm"}]
```


[User]
<image> Object: pinhead
Instruction: Point to the object and output the total count.

[Assistant]
```json
{"count": 1, "label": "pinhead"}
```


[User] <image> Locate all pinhead in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 1, "point_2d": [[30.0, 376.0]], "label": "pinhead"}
```


[User] <image> Count all pinhead in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 1, "bbox_2d": [[14.0, 358.0, 46.0, 394.0]], "label": "pinhead"}
```


[User] <image> Locate cluster.

[Assistant]
```json
[{"point_2d": [576.5, 40.5], "label": "cluster"}, {"point_2d": [186.0, 106.5], "label": "cluster"}]
```


[User] <image> Detect the sperm cluster and enclose it in a bounding box with coordinates.

[Assistant]
```json
[{"bbox_2d": [541.0, 12.0, 612.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> How many sperm cluster do you see?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Indicate each cluster in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 2, "point_2d": [[576.5, 40.5], [186.0, 106.5]], "label": "sperm cluster"}
```


[User] <image> Outline all instances of cluster with bounding boxes, then return the count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 12.0, 612.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "sperm cluster"}
```


[User] <image> Find the "normal sperm".

[Assistant]
```json
[{"point_2d": [159.0, 68.5], "label": "normal sperm"}, {"point_2d": [265.0, 17.5], "label": "normal sperm"}, {"point_2d": [172.0, 33.5], "label": "normal sperm"}, {"point_2d": [165.0, 39.5], "label": "normal sperm"}, {"point_2d": [170.0, 62.5], "label": "normal sperm"}, {"point_2d": [102.0, 72.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [105.5, 193.0], "label": "normal sperm"}, {"point_2d": [91.0, 234.0], "label": "normal sperm"}, {"point_2d": [270.0, 331.5], "label": "normal sperm"}, {"point_2d": [361.0, 365.5], "label": "normal sperm"}, {"point_2d": [522.0, 136.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [519.0, 35.5], "label": "normal sperm"}, {"point_2d": [429.0, 123.0], "label": "normal sperm"}, {"point_2d": [565.0, 214.5], "label": "normal sperm"}, {"point_2d": [555.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 299.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [594.5, 323.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 205.0], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```


[User] <image> Mark the sperm with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [147.0, 57.0, 171.0, 80.0], "label": "sperm"}, {"bbox_2d": [250.0, 3.0, 280.0, 32.0], "label": "sperm"}, {"bbox_2d": [161.0, 21.0, 183.0, 46.0], "label": "sperm"}, {"bbox_2d": [154.0, 28.0, 176.0, 51.0], "label": "sperm"}, {"bbox_2d": [156.0, 50.0, 184.0, 75.0], "label": "sperm"}, {"bbox_2d": [89.0, 58.0, 115.0, 86.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [92.0, 177.0, 119.0, 209.0], "label": "sperm"}, {"bbox_2d": [67.0, 210.0, 115.0, 258.0], "label": "sperm"}, {"bbox_2d": [255.0, 315.0, 285.0, 348.0], "label": "sperm"}, {"bbox_2d": [347.0, 351.0, 375.0, 380.0], "label": "sperm"}, {"bbox_2d": [509.0, 123.0, 535.0, 149.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [506.0, 22.0, 532.0, 49.0], "label": "sperm"}, {"bbox_2d": [405.0, 99.0, 453.0, 147.0], "label": "sperm"}, {"bbox_2d": [552.0, 200.0, 578.0, 229.0], "label": "sperm"}, {"bbox_2d": [541.0, 233.0, 570.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 282.0, 638.0, 317.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [574.0, 301.0, 615.0, 346.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 191.0, 600.0, 219.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> Can you see any sperm in the image? How many are there?

[Assistant]
```json
{"count": 27, "label": "sperm"}
```


[User] <image> Find each sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 27, "point_2d": [[159.0, 68.5], [265.0, 17.5], [172.0, 33.5], [165.0, 39.5], [170.0, 62.5], [102.0, 72.0], [93.0, 169.0], [105.5, 193.0], [91.0, 234.0], [270.0, 331.5], [361.0, 365.5], [522.0, 136.0], [463.0, 19.5], [519.0, 35.5], [429.0, 123.0], [565.0, 214.5], [555.5, 249.0], [610.5, 251.5], [622.5, 299.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [594.5, 323.5], [135.5, 79.0], [587.0, 205.0], [608.5, 293.0], [505.5, 435.5]], "label": "sperm"}
```


[User] <image> Draw bounding boxes around every sperm and then provide the total count.

[Assistant]
```json
{"count": 27, "bbox_2d": [[147.0, 57.0, 171.0, 80.0], [250.0, 3.0, 280.0, 32.0], [161.0, 21.0, 183.0, 46.0], [154.0, 28.0, 176.0, 51.0], [156.0, 50.0, 184.0, 75.0], [89.0, 58.0, 115.0, 86.0], [80.0, 156.0, 106.0, 182.0], [92.0, 177.0, 119.0, 209.0], [67.0, 210.0, 115.0, 258.0], [255.0, 315.0, 285.0, 348.0], [347.0, 351.0, 375.0, 380.0], [509.0, 123.0, 535.0, 149.0], [449.0, 5.0, 477.0, 34.0], [506.0, 22.0, 532.0, 49.0], [405.0, 99.0, 453.0, 147.0], [552.0, 200.0, 578.0, 229.0], [541.0, 233.0, 570.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 282.0, 638.0, 317.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [574.0, 301.0, 615.0, 346.0], [121.0, 63.0, 150.0, 95.0], [574.0, 191.0, 600.0, 219.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "sperm"}
```


[User] <image> If there is a pinhead present, indicate its position.

[Assistant]
```json
[{"point_2d": [29.0, 376.0], "label": "pinhead"}]
```


[User] <image> Return a bounding box that encloses pinhead sperm.

[Assistant]
```json
[{"bbox_2d": [13.0, 358.0, 45.0, 394.0], "label": "pinhead sperm"}]
```


[User] <image> How many pinhead sperm are there in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Find all the pinhead sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 1, "point_2d": [[29.0, 376.0]], "label": "pinhead sperm"}
```


[User] <image> Mark all pinhead sperm with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 1, "bbox_2d": [[13.0, 358.0, 45.0, 394.0]], "label": "pinhead sperm"}
```


[User] <image> Point out every sperm cluster in the image.

[Assistant]
```json
[{"point_2d": [576.5, 41.0], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Draw a bounding box around sperm cluster.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 612.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> Can you count every cluster in the picture?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Locate all cluster in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 2, "point_2d": [[576.5, 41.0], [186.0, 106.5]], "label": "cluster"}
```


[User] <image> Provide bounding box coordinates for each cluster and then specify the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 612.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "cluster"}
```


[User] <image> Find sperm.

[Assistant]
```json
[{"point_2d": [109.0, 78.5], "label": "sperm"}, {"point_2d": [267.0, 21.5], "label": "sperm"}, {"point_2d": [171.0, 35.5], "label": "sperm"}, {"point_2d": [163.0, 42.5], "label": "sperm"}, {"point_2d": [164.0, 65.5], "label": "sperm"}, {"point_2d": [102.5, 70.0], "label": "sperm"}, {"point_2d": [93.0, 169.0], "label": "sperm"}, {"point_2d": [106.5, 193.0], "label": "sperm"}, {"point_2d": [64.0, 230.0], "label": "sperm"}, {"point_2d": [272.0, 332.5], "label": "sperm"}, {"point_2d": [363.0, 365.5], "label": "sperm"}, {"point_2d": [557.0, 154.0], "label": "sperm"}, {"point_2d": [463.0, 19.5], "label": "sperm"}, {"point_2d": [520.0, 35.5], "label": "sperm"}, {"point_2d": [442.5, 136.0], "label": "sperm"}, {"point_2d": [566.0, 214.5], "label": "sperm"}, {"point_2d": [556.5, 249.0], "label": "sperm"}, {"point_2d": [610.5, 251.5], "label": "sperm"}, {"point_2d": [622.5, 300.5], "label": "sperm"}, {"point_2d": [552.5, 446.0], "label": "sperm"}, {"point_2d": [78.0, 467.5], "label": "sperm"}, {"point_2d": [630.5, 51.5], "label": "sperm"}, {"point_2d": [563.5, 306.5], "label": "sperm"}, {"point_2d": [135.5, 79.0], "label": "sperm"}, {"point_2d": [587.0, 204.0], "label": "sperm"}, {"point_2d": [98.5, 466.0], "label": "sperm"}, {"point_2d": [608.5, 293.0], "label": "sperm"}, {"point_2d": [505.5, 435.5], "label": "sperm"}]
```


[User] <image> Find the sperm in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [97.0, 67.0, 121.0, 90.0], "label": "sperm"}, {"bbox_2d": [252.0, 7.0, 282.0, 36.0], "label": "sperm"}, {"bbox_2d": [160.0, 23.0, 182.0, 48.0], "label": "sperm"}, {"bbox_2d": [152.0, 31.0, 174.0, 54.0], "label": "sperm"}, {"bbox_2d": [150.0, 53.0, 178.0, 78.0], "label": "sperm"}, {"bbox_2d": [89.0, 56.0, 116.0, 84.0], "label": "sperm"}, {"bbox_2d": [80.0, 156.0, 106.0, 182.0], "label": "sperm"}, {"bbox_2d": [93.0, 177.0, 120.0, 209.0], "label": "sperm"}, {"bbox_2d": [40.0, 206.0, 88.0, 254.0], "label": "sperm"}, {"bbox_2d": [257.0, 316.0, 287.0, 349.0], "label": "sperm"}, {"bbox_2d": [349.0, 351.0, 377.0, 380.0], "label": "sperm"}, {"bbox_2d": [544.0, 141.0, 570.0, 167.0], "label": "sperm"}, {"bbox_2d": [449.0, 5.0, 477.0, 34.0], "label": "sperm"}, {"bbox_2d": [507.0, 22.0, 533.0, 49.0], "label": "sperm"}, {"bbox_2d": [419.0, 112.0, 466.0, 160.0], "label": "sperm"}, {"bbox_2d": [553.0, 200.0, 579.0, 229.0], "label": "sperm"}, {"bbox_2d": [542.0, 233.0, 571.0, 265.0], "label": "sperm"}, {"bbox_2d": [595.0, 235.0, 626.0, 268.0], "label": "sperm"}, {"bbox_2d": [607.0, 283.0, 638.0, 318.0], "label": "sperm"}, {"bbox_2d": [538.0, 431.0, 567.0, 461.0], "label": "sperm"}, {"bbox_2d": [62.0, 455.0, 94.0, 480.0], "label": "sperm"}, {"bbox_2d": [621.0, 36.0, 640.0, 67.0], "label": "sperm"}, {"bbox_2d": [543.0, 284.0, 584.0, 329.0], "label": "sperm"}, {"bbox_2d": [121.0, 63.0, 150.0, 95.0], "label": "sperm"}, {"bbox_2d": [574.0, 190.0, 600.0, 218.0], "label": "sperm"}, {"bbox_2d": [77.0, 452.0, 120.0, 480.0], "label": "sperm"}, {"bbox_2d": [596.0, 279.0, 621.0, 307.0], "label": "sperm"}, {"bbox_2d": [495.0, 426.0, 516.0, 445.0], "label": "sperm"}]
```


[User] <image> How many normal sperm.

[Assistant]
```json
{"count": 28, "label": "normal sperm"}
```


[User] <image> Locate the normal sperm and count them, then point to them.

[Assistant]
```json
{"count": 28, "point_2d": [[109.0, 78.5], [267.0, 21.5], [171.0, 35.5], [163.0, 42.5], [164.0, 65.5], [102.5, 70.0], [93.0, 169.0], [106.5, 193.0], [64.0, 230.0], [272.0, 332.5], [363.0, 365.5], [557.0, 154.0], [463.0, 19.5], [520.0, 35.5], [442.5, 136.0], [566.0, 214.5], [556.5, 249.0], [610.5, 251.5], [622.5, 300.5], [552.5, 446.0], [78.0, 467.5], [630.5, 51.5], [563.5, 306.5], [135.5, 79.0], [587.0, 204.0], [98.5, 466.0], [608.5, 293.0], [505.5, 435.5]], "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 28, "bbox_2d": [[97.0, 67.0, 121.0, 90.0], [252.0, 7.0, 282.0, 36.0], [160.0, 23.0, 182.0, 48.0], [152.0, 31.0, 174.0, 54.0], [150.0, 53.0, 178.0, 78.0], [89.0, 56.0, 116.0, 84.0], [80.0, 156.0, 106.0, 182.0], [93.0, 177.0, 120.0, 209.0], [40.0, 206.0, 88.0, 254.0], [257.0, 316.0, 287.0, 349.0], [349.0, 351.0, 377.0, 380.0], [544.0, 141.0, 570.0, 167.0], [449.0, 5.0, 477.0, 34.0], [507.0, 22.0, 533.0, 49.0], [419.0, 112.0, 466.0, 160.0], [553.0, 200.0, 579.0, 229.0], [542.0, 233.0, 571.0, 265.0], [595.0, 235.0, 626.0, 268.0], [607.0, 283.0, 638.0, 318.0], [538.0, 431.0, 567.0, 461.0], [62.0, 455.0, 94.0, 480.0], [621.0, 36.0, 640.0, 67.0], [543.0, 284.0, 584.0, 329.0], [121.0, 63.0, 150.0, 95.0], [574.0, 190.0, 600.0, 218.0], [77.0, 452.0, 120.0, 480.0], [596.0, 279.0, 621.0, 307.0], [495.0, 426.0, 516.0, 445.0]], "label": "normal sperm"}
```


[User] <image> Point to any pinheads in the image.

[Assistant]
```json
[{"point_2d": [31.0, 376.0], "label": "pinhead"}]
```


[User] <image> Return the rectangular bounding box that covers pinhead in the image.

[Assistant]
```json
[{"bbox_2d": [15.0, 358.0, 47.0, 394.0], "label": "pinhead"}]
```


[User] <image> Find all the pinhead sperm. How many are there?

[Assistant]
```json
{"count": 1, "label": "pinhead sperm"}
```


[User] <image> Show me each pinhead sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 1, "point_2d": [[31.0, 376.0]], "label": "pinhead sperm"}
```


[User] <image> Provide the total number of pinhead sperm and for each, supply a bounding box.

[Assistant]
```json
{"count": 1, "bbox_2d": [[15.0, 358.0, 47.0, 394.0]], "label": "pinhead sperm"}
```


[User] <image> If there is a sperm cluster present, indicate its position.

[Assistant]
```json
[{"point_2d": [577.0, 41.0], "label": "sperm cluster"}, {"point_2d": [186.0, 106.5], "label": "sperm cluster"}]
```


[User] <image> Specify the bounding box for the sperm cluster in the image.

[Assistant]
```json
[{"bbox_2d": [541.0, 13.0, 613.0, 69.0], "label": "sperm cluster"}, {"bbox_2d": [165.0, 90.0, 207.0, 123.0], "label": "sperm cluster"}]
```


[User] <image> Count the cluster.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Point out every cluster you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 2, "point_2d": [[577.0, 41.0], [186.0, 106.5]], "label": "cluster"}
```


[User] <image> Find all cluster in the image, draw bounding boxes around them, and then count them.

[Assistant]
```json
{"count": 2, "bbox_2d": [[541.0, 13.0, 613.0, 69.0], [165.0, 90.0, 207.0, 123.0]], "label": "cluster"}
```


[User] <image> show me all visible normal sperms

[Assistant]
```json
[{"point_2d": [97.0, 78.5], "label": "normal sperm"}, {"point_2d": [269.0, 23.5], "label": "normal sperm"}, {"point_2d": [171.0, 35.5], "label": "normal sperm"}, {"point_2d": [162.0, 42.5], "label": "normal sperm"}, {"point_2d": [162.0, 65.5], "label": "normal sperm"}, {"point_2d": [103.5, 70.0], "label": "normal sperm"}, {"point_2d": [93.0, 169.0], "label": "normal sperm"}, {"point_2d": [106.5, 192.0], "label": "normal sperm"}, {"point_2d": [59.0, 226.0], "label": "normal sperm"}, {"point_2d": [272.0, 332.5], "label": "normal sperm"}, {"point_2d": [364.0, 365.5], "label": "normal sperm"}, {"point_2d": [567.0, 158.0], "label": "normal sperm"}, {"point_2d": [463.0, 19.5], "label": "normal sperm"}, {"point_2d": [520.0, 35.5], "label": "normal sperm"}, {"point_2d": [449.0, 139.0], "label": "normal sperm"}, {"point_2d": [566.0, 214.5], "label": "normal sperm"}, {"point_2d": [556.5, 249.0], "label": "normal sperm"}, {"point_2d": [610.5, 251.5], "label": "normal sperm"}, {"point_2d": [622.5, 300.5], "label": "normal sperm"}, {"point_2d": [552.5, 446.0], "label": "normal sperm"}, {"point_2d": [78.0, 467.5], "label": "normal sperm"}, {"point_2d": [630.5, 51.5], "label": "normal sperm"}, {"point_2d": [551.5, 305.5], "label": "normal sperm"}, {"point_2d": [135.5, 79.0], "label": "normal sperm"}, {"point_2d": [587.0, 203.0], "label": "normal sperm"}, {"point_2d": [98.5, 464.5], "label": "normal sperm"}, {"point_2d": [608.5, 293.0], "label": "normal sperm"}, {"point_2d": [505.5, 435.5], "label": "normal sperm"}]
```