[User] <image> Locate a sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> count sperm cluster

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Mark each sperm cluster with a point, then output how many there are.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Mark all sperm cluster with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Generate a list of points showing where the normal sperms are.

[Assistant]
```json
[{"point_2d": [99.0, 178.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [449.0, 234.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [42.5, 183.0], "label": "normal sperm"}, {"point_2d": [298.0, 442.5], "label": "normal sperm"}, {"point_2d": [80.5, 342.0], "label": "normal sperm"}, {"point_2d": [211.5, 412.0], "label": "normal sperm"}, {"point_2d": [24.5, 428.0], "label": "normal sperm"}, {"point_2d": [288.0, 409.0], "label": "normal sperm"}, {"point_2d": [624.5, 363.5], "label": "normal sperm"}, {"point_2d": [627.0, 230.5], "label": "normal sperm"}, {"point_2d": [39.0, 159.5], "label": "normal sperm"}]
```


[User] <image> Return the rectangular bounding box that covers sperm in the image.

[Assistant]
```json
[{"bbox_2d": [90.0, 168.0, 108.0, 188.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [435.0, 220.0, 463.0, 248.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [29.0, 169.0, 56.0, 197.0], "label": "sperm"}, {"bbox_2d": [284.0, 429.0, 312.0, 456.0], "label": "sperm"}, {"bbox_2d": [68.0, 331.0, 93.0, 353.0], "label": "sperm"}, {"bbox_2d": [201.0, 402.0, 222.0, 422.0], "label": "sperm"}, {"bbox_2d": [17.0, 420.0, 32.0, 436.0], "label": "sperm"}, {"bbox_2d": [276.0, 399.0, 300.0, 419.0], "label": "sperm"}, {"bbox_2d": [616.0, 356.0, 633.0, 371.0], "label": "sperm"}, {"bbox_2d": [619.0, 223.0, 635.0, 238.0], "label": "sperm"}, {"bbox_2d": [27.0, 149.0, 51.0, 170.0], "label": "sperm"}]
```


[User] <image> count normal sperm.

[Assistant]
```json
{"count": 21, "label": "normal sperm"}
```


[User] <image> Point to all normal sperm in the image and then count them.

[Assistant]
```json
{"count": 21, "point_2d": [[99.0, 178.0], [327.5, 91.0], [449.0, 234.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [42.5, 183.0], [298.0, 442.5], [80.5, 342.0], [211.5, 412.0], [24.5, 428.0], [288.0, 409.0], [624.5, 363.5], [627.0, 230.5], [39.0, 159.5]], "label": "normal sperm"}
```


[User] <image> Find all normal sperm in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 21, "bbox_2d": [[90.0, 168.0, 108.0, 188.0], [315.0, 80.0, 340.0, 102.0], [435.0, 220.0, 463.0, 248.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [29.0, 169.0, 56.0, 197.0], [284.0, 429.0, 312.0, 456.0], [68.0, 331.0, 93.0, 353.0], [201.0, 402.0, 222.0, 422.0], [17.0, 420.0, 32.0, 436.0], [276.0, 399.0, 300.0, 419.0], [616.0, 356.0, 633.0, 371.0], [619.0, 223.0, 635.0, 238.0], [27.0, 149.0, 51.0, 170.0]], "label": "normal sperm"}
```


[User] <image> Find cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Outline the cluster using a bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User]
<image> Object: sperm cluster
Instruction: How many are there?

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Point out every sperm cluster you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Identify each sperm cluster by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> If there are any sperms in the image, show me where they are.

[Assistant]
```json
[{"point_2d": [99.0, 178.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [454.0, 233.5], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [45.0, 175.0], "label": "sperm"}, {"point_2d": [297.0, 430.5], "label": "sperm"}, {"point_2d": [66.5, 335.5], "label": "sperm"}, {"point_2d": [204.5, 416.0], "label": "sperm"}, {"point_2d": [20.5, 420.0], "label": "sperm"}, {"point_2d": [322.0, 399.0], "label": "sperm"}, {"point_2d": [629.0, 350.5], "label": "sperm"}, {"point_2d": [629.5, 210.5], "label": "sperm"}, {"point_2d": [39.0, 159.5], "label": "sperm"}]
```


[User] <image> Outline the area containing sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [90.0, 168.0, 108.0, 188.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [440.0, 220.0, 468.0, 247.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [31.0, 161.0, 59.0, 189.0], "label": "sperm"}, {"bbox_2d": [283.0, 417.0, 311.0, 444.0], "label": "sperm"}, {"bbox_2d": [54.0, 324.0, 79.0, 347.0], "label": "sperm"}, {"bbox_2d": [194.0, 406.0, 215.0, 426.0], "label": "sperm"}, {"bbox_2d": [13.0, 412.0, 28.0, 428.0], "label": "sperm"}, {"bbox_2d": [310.0, 389.0, 334.0, 409.0], "label": "sperm"}, {"bbox_2d": [619.0, 339.0, 639.0, 362.0], "label": "sperm"}, {"bbox_2d": [619.0, 201.0, 640.0, 220.0], "label": "sperm"}, {"bbox_2d": [27.0, 149.0, 51.0, 170.0], "label": "sperm"}]
```


[User] <image> count normal sperm

[Assistant]
```json
{"count": 21, "label": "normal sperm"}
```


[User] <image> Locate the sperm and count them, then point to them.

[Assistant]
```json
{"count": 21, "point_2d": [[99.0, 178.0], [327.5, 91.0], [454.0, 233.5], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [45.0, 175.0], [297.0, 430.5], [66.5, 335.5], [204.5, 416.0], [20.5, 420.0], [322.0, 399.0], [629.0, 350.5], [629.5, 210.5], [39.0, 159.5]], "label": "normal sperm"}
```


[User] <image> Identify each sperm by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 21, "bbox_2d": [[90.0, 168.0, 108.0, 188.0], [315.0, 80.0, 340.0, 102.0], [440.0, 220.0, 468.0, 247.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [31.0, 161.0, 59.0, 189.0], [283.0, 417.0, 311.0, 444.0], [54.0, 324.0, 79.0, 347.0], [194.0, 406.0, 215.0, 426.0], [13.0, 412.0, 28.0, 428.0], [310.0, 389.0, 334.0, 409.0], [619.0, 339.0, 639.0, 362.0], [619.0, 201.0, 640.0, 220.0], [27.0, 149.0, 51.0, 170.0]], "label": "normal sperm"}
```


[User] <image> If there are any clusters present, indicate their positions.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Generate bounding box coordinates for the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User]
<image> Object: cluster
Instruction: Point to the object and output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Point to each instance of cluster and then output their total number.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Mark each cluster with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Find any normal sperms

[Assistant]
```json
[{"point_2d": [99.0, 178.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [449.0, 231.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [46.5, 195.0], "label": "normal sperm"}, {"point_2d": [287.0, 428.5], "label": "normal sperm"}, {"point_2d": [95.5, 339.0], "label": "normal sperm"}, {"point_2d": [194.5, 415.0], "label": "normal sperm"}, {"point_2d": [27.5, 435.0], "label": "normal sperm"}, {"point_2d": [265.0, 415.5], "label": "normal sperm"}, {"point_2d": [631.5, 366.5], "label": "normal sperm"}, {"point_2d": [634.5, 231.5], "label": "normal sperm"}, {"point_2d": [40.0, 158.5], "label": "normal sperm"}]
```


[User] <image> Return a bounding box that encloses sperm.

[Assistant]
```json
[{"bbox_2d": [90.0, 168.0, 108.0, 188.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [435.0, 217.0, 463.0, 245.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [33.0, 181.0, 60.0, 209.0], "label": "sperm"}, {"bbox_2d": [273.0, 415.0, 301.0, 442.0], "label": "sperm"}, {"bbox_2d": [83.0, 328.0, 108.0, 350.0], "label": "sperm"}, {"bbox_2d": [184.0, 405.0, 205.0, 425.0], "label": "sperm"}, {"bbox_2d": [20.0, 427.0, 35.0, 443.0], "label": "sperm"}, {"bbox_2d": [256.0, 403.0, 274.0, 428.0], "label": "sperm"}, {"bbox_2d": [623.0, 359.0, 640.0, 374.0], "label": "sperm"}, {"bbox_2d": [629.0, 223.0, 640.0, 240.0], "label": "sperm"}, {"bbox_2d": [28.0, 148.0, 52.0, 169.0], "label": "sperm"}]
```


[User] <image> how many normal sperm.

[Assistant]
```json
{"count": 21, "label": "normal sperm"}
```


[User] <image> Point to each instance of sperm and then output their total number.

[Assistant]
```json
{"count": 21, "point_2d": [[99.0, 178.0], [327.5, 91.0], [449.0, 231.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [46.5, 195.0], [287.0, 428.5], [95.5, 339.0], [194.5, 415.0], [27.5, 435.0], [265.0, 415.5], [631.5, 366.5], [634.5, 231.5], [40.0, 158.5]], "label": "normal sperm"}
```


[User] <image> Provide bounding box coordinates for each sperm and then specify the total count.

[Assistant]
```json
{"count": 21, "bbox_2d": [[90.0, 168.0, 108.0, 188.0], [315.0, 80.0, 340.0, 102.0], [435.0, 217.0, 463.0, 245.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [33.0, 181.0, 60.0, 209.0], [273.0, 415.0, 301.0, 442.0], [83.0, 328.0, 108.0, 350.0], [184.0, 405.0, 205.0, 425.0], [20.0, 427.0, 35.0, 443.0], [256.0, 403.0, 274.0, 428.0], [623.0, 359.0, 640.0, 374.0], [629.0, 223.0, 640.0, 240.0], [28.0, 148.0, 52.0, 169.0]], "label": "normal sperm"}
```


[User] <image> Find the sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Draw a bounding box around sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Point to all occurrences of "cluster" and output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Point to each instance of cluster and then output their total number.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Output a list of bounding boxes for every cluster and the overall count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Point to any sperms in the image.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [471.0, 253.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [39.5, 134.0], "label": "sperm"}, {"point_2d": [287.0, 433.5], "label": "sperm"}, {"point_2d": [243.5, 411.0], "label": "sperm"}, {"point_2d": [7.5, 381.0], "label": "sperm"}, {"point_2d": [429.0, 340.0], "label": "sperm"}, {"point_2d": [582.5, 294.5], "label": "sperm"}, {"point_2d": [629.5, 98.5], "label": "sperm"}, {"point_2d": [616.5, 386.5], "label": "sperm"}, {"point_2d": [37.0, 161.5], "label": "sperm"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [457.0, 239.0, 485.0, 267.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [26.0, 120.0, 53.0, 148.0], "label": "sperm"}, {"bbox_2d": [274.0, 421.0, 300.0, 446.0], "label": "sperm"}, {"bbox_2d": [233.0, 401.0, 254.0, 421.0], "label": "sperm"}, {"bbox_2d": [0.0, 373.0, 15.0, 389.0], "label": "sperm"}, {"bbox_2d": [417.0, 328.0, 441.0, 352.0], "label": "sperm"}, {"bbox_2d": [569.0, 282.0, 596.0, 307.0], "label": "sperm"}, {"bbox_2d": [619.0, 89.0, 640.0, 108.0], "label": "sperm"}, {"bbox_2d": [604.0, 373.0, 629.0, 400.0], "label": "sperm"}, {"bbox_2d": [25.0, 151.0, 49.0, 172.0], "label": "sperm"}]
```


[User] <image> How many sperm are visible?

[Assistant]
```json
{"count": 21, "label": "sperm"}
```


[User] <image> Point out every normal sperm you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 21, "point_2d": [[98.0, 177.0], [327.5, 91.0], [471.0, 253.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [39.5, 134.0], [287.0, 433.5], [243.5, 411.0], [7.5, 381.0], [429.0, 340.0], [582.5, 294.5], [629.5, 98.5], [616.5, 386.5], [37.0, 161.5]], "label": "sperm"}
```


[User] <image> Find all normal sperm in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 21, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [457.0, 239.0, 485.0, 267.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [26.0, 120.0, 53.0, 148.0], [274.0, 421.0, 300.0, 446.0], [233.0, 401.0, 254.0, 421.0], [0.0, 373.0, 15.0, 389.0], [417.0, 328.0, 441.0, 352.0], [569.0, 282.0, 596.0, 307.0], [619.0, 89.0, 640.0, 108.0], [604.0, 373.0, 629.0, 400.0], [25.0, 151.0, 49.0, 172.0]], "label": "sperm"}
```


[User] <image> Please find clusters and show me where they are.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Draw a bounding box around sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Can you point out all cluster in this image? How many are there?

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Count every sperm cluster in the picture, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Count all sperm cluster in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Find any sperms in the picture

[Assistant]
```json
[{"point_2d": [99.0, 178.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [449.0, 235.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [42.5, 182.0], "label": "sperm"}, {"point_2d": [295.0, 441.5], "label": "sperm"}, {"point_2d": [81.5, 337.0], "label": "sperm"}, {"point_2d": [214.5, 410.0], "label": "sperm"}, {"point_2d": [23.5, 427.0], "label": "sperm"}, {"point_2d": [295.0, 408.5], "label": "sperm"}, {"point_2d": [624.0, 359.0], "label": "sperm"}, {"point_2d": [623.0, 228.5], "label": "sperm"}, {"point_2d": [39.0, 159.5], "label": "sperm"}]
```


[User] <image> Specify the bounding box for the normal sperm in the image.

[Assistant]
```json
[{"bbox_2d": [90.0, 168.0, 108.0, 188.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [435.0, 221.0, 463.0, 249.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [29.0, 168.0, 56.0, 196.0], "label": "normal sperm"}, {"bbox_2d": [281.0, 428.0, 309.0, 455.0], "label": "normal sperm"}, {"bbox_2d": [69.0, 326.0, 94.0, 348.0], "label": "normal sperm"}, {"bbox_2d": [204.0, 400.0, 225.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [16.0, 419.0, 31.0, 435.0], "label": "normal sperm"}, {"bbox_2d": [283.0, 398.0, 307.0, 419.0], "label": "normal sperm"}, {"bbox_2d": [615.0, 350.0, 633.0, 368.0], "label": "normal sperm"}, {"bbox_2d": [615.0, 221.0, 631.0, 236.0], "label": "normal sperm"}, {"bbox_2d": [27.0, 149.0, 51.0, 170.0], "label": "normal sperm"}]
```


[User] <image> Tell me where each normal sperm is.

[Assistant]
```json
{"count": 21, "label": "normal sperm"}
```


[User] <image> Indicate each normal sperm in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 21, "point_2d": [[99.0, 178.0], [327.5, 91.0], [449.0, 235.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [42.5, 182.0], [295.0, 441.5], [81.5, 337.0], [214.5, 410.0], [23.5, 427.0], [295.0, 408.5], [624.0, 359.0], [623.0, 228.5], [39.0, 159.5]], "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 21, "bbox_2d": [[90.0, 168.0, 108.0, 188.0], [315.0, 80.0, 340.0, 102.0], [435.0, 221.0, 463.0, 249.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [29.0, 168.0, 56.0, 196.0], [281.0, 428.0, 309.0, 455.0], [69.0, 326.0, 94.0, 348.0], [204.0, 400.0, 225.0, 420.0], [16.0, 419.0, 31.0, 435.0], [283.0, 398.0, 307.0, 419.0], [615.0, 350.0, 633.0, 368.0], [615.0, 221.0, 631.0, 236.0], [27.0, 149.0, 51.0, 170.0]], "label": "normal sperm"}
```


[User] <image> Locate all sperm clusters.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Draw a bounding box around cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Count all the cluster

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Mark each cluster with a point, then output how many there are.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Count every cluster and return a list of bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Point: Where are the sperms?

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [470.0, 257.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [34.5, 137.0], "label": "sperm"}, {"point_2d": [285.5, 433.5], "label": "sperm"}, {"point_2d": [243.5, 410.0], "label": "sperm"}, {"point_2d": [7.5, 378.5], "label": "sperm"}, {"point_2d": [445.0, 335.5], "label": "sperm"}, {"point_2d": [590.5, 297.5], "label": "sperm"}, {"point_2d": [629.5, 93.5], "label": "sperm"}, {"point_2d": [619.5, 390.5], "label": "sperm"}, {"point_2d": [37.0, 161.5], "label": "sperm"}]
```


[User] <image> Mark the object sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [456.0, 243.0, 484.0, 271.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [21.0, 123.0, 48.0, 151.0], "label": "sperm"}, {"bbox_2d": [273.0, 421.0, 298.0, 446.0], "label": "sperm"}, {"bbox_2d": [233.0, 400.0, 254.0, 420.0], "label": "sperm"}, {"bbox_2d": [0.0, 370.0, 15.0, 387.0], "label": "sperm"}, {"bbox_2d": [433.0, 323.0, 457.0, 348.0], "label": "sperm"}, {"bbox_2d": [578.0, 285.0, 603.0, 310.0], "label": "sperm"}, {"bbox_2d": [619.0, 84.0, 640.0, 103.0], "label": "sperm"}, {"bbox_2d": [607.0, 377.0, 632.0, 404.0], "label": "sperm"}, {"bbox_2d": [25.0, 151.0, 49.0, 172.0], "label": "sperm"}]
```


[User] <image> Find all the sperm. How many are there?

[Assistant]
```json
{"count": 21, "label": "sperm"}
```


[User] <image> Locate all normal sperm in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 21, "point_2d": [[98.0, 177.0], [327.5, 91.0], [470.0, 257.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [34.5, 137.0], [285.5, 433.5], [243.5, 410.0], [7.5, 378.5], [445.0, 335.5], [590.5, 297.5], [629.5, 93.5], [619.5, 390.5], [37.0, 161.5]], "label": "sperm"}
```


[User] <image> Provide the total number of normal sperm and for each, supply a bounding box.

[Assistant]
```json
{"count": 21, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [456.0, 243.0, 484.0, 271.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [21.0, 123.0, 48.0, 151.0], [273.0, 421.0, 298.0, 446.0], [233.0, 400.0, 254.0, 420.0], [0.0, 370.0, 15.0, 387.0], [433.0, 323.0, 457.0, 348.0], [578.0, 285.0, 603.0, 310.0], [619.0, 84.0, 640.0, 103.0], [607.0, 377.0, 632.0, 404.0], [25.0, 151.0, 49.0, 172.0]], "label": "sperm"}
```


[User] <image> Point out every cluster in the image.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Identify the sperm cluster in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> How many cluster are there in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Indicate each cluster in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Find all cluster in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Locate the sperm.

[Assistant]
```json
[{"point_2d": [99.0, 178.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [455.0, 233.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [44.5, 174.0], "label": "sperm"}, {"point_2d": [297.0, 432.5], "label": "sperm"}, {"point_2d": [64.5, 334.0], "label": "sperm"}, {"point_2d": [203.5, 416.0], "label": "sperm"}, {"point_2d": [19.5, 420.0], "label": "sperm"}, {"point_2d": [321.0, 393.5], "label": "sperm"}, {"point_2d": [630.0, 350.5], "label": "sperm"}, {"point_2d": [628.5, 206.5], "label": "sperm"}, {"point_2d": [39.0, 159.5], "label": "sperm"}]
```


[User] <image> Outline the normal sperm using a bounding box.

[Assistant]
```json
[{"bbox_2d": [90.0, 168.0, 108.0, 188.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [441.0, 219.0, 469.0, 247.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [31.0, 160.0, 58.0, 188.0], "label": "normal sperm"}, {"bbox_2d": [283.0, 419.0, 311.0, 446.0], "label": "normal sperm"}, {"bbox_2d": [52.0, 323.0, 77.0, 345.0], "label": "normal sperm"}, {"bbox_2d": [193.0, 406.0, 214.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [12.0, 412.0, 27.0, 428.0], "label": "normal sperm"}, {"bbox_2d": [309.0, 383.0, 333.0, 404.0], "label": "normal sperm"}, {"bbox_2d": [620.0, 339.0, 640.0, 362.0], "label": "normal sperm"}, {"bbox_2d": [618.0, 197.0, 639.0, 216.0], "label": "normal sperm"}, {"bbox_2d": [27.0, 149.0, 51.0, 170.0], "label": "normal sperm"}]
```


[User] <image> If there are any sperm present, indicate their positions and output the total count.

[Assistant]
```json
{"count": 21, "label": "sperm"}
```


[User] <image> Count the sperm in the image, then point to them.

[Assistant]
```json
{"count": 21, "point_2d": [[99.0, 178.0], [327.5, 91.0], [455.0, 233.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [44.5, 174.0], [297.0, 432.5], [64.5, 334.0], [203.5, 416.0], [19.5, 420.0], [321.0, 393.5], [630.0, 350.5], [628.5, 206.5], [39.0, 159.5]], "label": "sperm"}
```


[User] <image> Outline all instances of sperm with bounding boxes, then return the count.

[Assistant]
```json
{"count": 21, "bbox_2d": [[90.0, 168.0, 108.0, 188.0], [315.0, 80.0, 340.0, 102.0], [441.0, 219.0, 469.0, 247.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [31.0, 160.0, 58.0, 188.0], [283.0, 419.0, 311.0, 446.0], [52.0, 323.0, 77.0, 345.0], [193.0, 406.0, 214.0, 426.0], [12.0, 412.0, 27.0, 428.0], [309.0, 383.0, 333.0, 404.0], [620.0, 339.0, 640.0, 362.0], [618.0, 197.0, 639.0, 216.0], [27.0, 149.0, 51.0, 170.0]], "label": "sperm"}
```


[User] <image> Show me where a sperm cluster is.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Return the bounding box of the cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Point at the cluster and then count them.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Point to and count the cluster in the picture.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Identify each cluster by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Find sperm.

[Assistant]
```json
[{"point_2d": [99.0, 178.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [449.0, 236.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [43.5, 178.0], "label": "sperm"}, {"point_2d": [294.0, 435.5], "label": "sperm"}, {"point_2d": [76.5, 334.0], "label": "sperm"}, {"point_2d": [210.5, 414.0], "label": "sperm"}, {"point_2d": [21.5, 424.0], "label": "sperm"}, {"point_2d": [307.0, 396.0], "label": "sperm"}, {"point_2d": [625.0, 350.5], "label": "sperm"}, {"point_2d": [626.5, 224.5], "label": "sperm"}, {"point_2d": [39.0, 159.5], "label": "sperm"}]
```


[User] <image> Identify the normal sperm in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [90.0, 168.0, 108.0, 188.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [435.0, 222.0, 463.0, 250.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [30.0, 164.0, 57.0, 192.0], "label": "normal sperm"}, {"bbox_2d": [280.0, 422.0, 308.0, 449.0], "label": "normal sperm"}, {"bbox_2d": [64.0, 323.0, 89.0, 345.0], "label": "normal sperm"}, {"bbox_2d": [200.0, 404.0, 221.0, 424.0], "label": "normal sperm"}, {"bbox_2d": [14.0, 416.0, 29.0, 432.0], "label": "normal sperm"}, {"bbox_2d": [295.0, 386.0, 319.0, 406.0], "label": "normal sperm"}, {"bbox_2d": [615.0, 339.0, 635.0, 362.0], "label": "normal sperm"}, {"bbox_2d": [616.0, 215.0, 637.0, 234.0], "label": "normal sperm"}, {"bbox_2d": [27.0, 149.0, 51.0, 170.0], "label": "normal sperm"}]
```


[User] <image> Can you count the number of sperm in the image?

[Assistant]
```json
{"count": 21, "label": "sperm"}
```


[User] <image> Point to and count the normal sperm in the picture.

[Assistant]
```json
{"count": 21, "point_2d": [[99.0, 178.0], [327.5, 91.0], [449.0, 236.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [43.5, 178.0], [294.0, 435.5], [76.5, 334.0], [210.5, 414.0], [21.5, 424.0], [307.0, 396.0], [625.0, 350.5], [626.5, 224.5], [39.0, 159.5]], "label": "sperm"}
```


[User] <image> Find all normal sperm in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 21, "bbox_2d": [[90.0, 168.0, 108.0, 188.0], [315.0, 80.0, 340.0, 102.0], [435.0, 222.0, 463.0, 250.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [30.0, 164.0, 57.0, 192.0], [280.0, 422.0, 308.0, 449.0], [64.0, 323.0, 89.0, 345.0], [200.0, 404.0, 221.0, 424.0], [14.0, 416.0, 29.0, 432.0], [295.0, 386.0, 319.0, 406.0], [615.0, 339.0, 635.0, 362.0], [616.0, 215.0, 637.0, 234.0], [27.0, 149.0, 51.0, 170.0]], "label": "sperm"}
```


[User] <image> Point: Where are the clusters?

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Enclose cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Point to all the visible cluster output the total count.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Locate the sperm cluster and count them, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Draw bounding boxes around every sperm cluster and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Where are the sperms?

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [458.0, 237.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [38.5, 169.0], "label": "sperm"}, {"point_2d": [301.0, 429.5], "label": "sperm"}, {"point_2d": [40.5, 329.0], "label": "sperm"}, {"point_2d": [213.5, 413.0], "label": "sperm"}, {"point_2d": [15.5, 411.0], "label": "sperm"}, {"point_2d": [345.0, 371.5], "label": "sperm"}, {"point_2d": [625.0, 336.5], "label": "sperm"}, {"point_2d": [617.5, 165.5], "label": "sperm"}, {"point_2d": [591.0, 451.0], "label": "sperm"}, {"point_2d": [38.0, 159.5], "label": "sperm"}]
```


[User] <image> Locate the normal sperm and mark it with a bounding box in the image.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [444.0, 223.0, 472.0, 251.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [25.0, 155.0, 52.0, 183.0], "label": "normal sperm"}, {"bbox_2d": [287.0, 416.0, 315.0, 443.0], "label": "normal sperm"}, {"bbox_2d": [28.0, 318.0, 53.0, 340.0], "label": "normal sperm"}, {"bbox_2d": [203.0, 403.0, 224.0, 423.0], "label": "normal sperm"}, {"bbox_2d": [8.0, 403.0, 23.0, 419.0], "label": "normal sperm"}, {"bbox_2d": [333.0, 361.0, 357.0, 382.0], "label": "normal sperm"}, {"bbox_2d": [615.0, 325.0, 635.0, 348.0], "label": "normal sperm"}, {"bbox_2d": [607.0, 156.0, 628.0, 175.0], "label": "normal sperm"}, {"bbox_2d": [579.0, 441.0, 603.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [26.0, 149.0, 50.0, 170.0], "label": "normal sperm"}]
```


[User] <image> If you see any sperm in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 22, "label": "sperm"}
```


[User] <image> Mark all visible normal sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [458.0, 237.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [38.5, 169.0], [301.0, 429.5], [40.5, 329.0], [213.5, 413.0], [15.5, 411.0], [345.0, 371.5], [625.0, 336.5], [617.5, 165.5], [591.0, 451.0], [38.0, 159.5]], "label": "sperm"}
```


[User] <image> Draw bounding boxes around every normal sperm and then provide the total count.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [444.0, 223.0, 472.0, 251.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [25.0, 155.0, 52.0, 183.0], [287.0, 416.0, 315.0, 443.0], [28.0, 318.0, 53.0, 340.0], [203.0, 403.0, 224.0, 423.0], [8.0, 403.0, 23.0, 419.0], [333.0, 361.0, 357.0, 382.0], [615.0, 325.0, 635.0, 348.0], [607.0, 156.0, 628.0, 175.0], [579.0, 441.0, 603.0, 461.0], [26.0, 149.0, 50.0, 170.0]], "label": "sperm"}
```


[User] <image> Locate every sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Detect the cluster and enclose it in a bounding box with coordinates.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Tell me how many sperm cluster are in the image

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Mark each sperm cluster with a point, then output how many there are.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Count every sperm cluster and return a list of bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Locate all normal sperms.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [468.0, 252.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [33.5, 143.0], "label": "normal sperm"}, {"point_2d": [290.0, 433.5], "label": "normal sperm"}, {"point_2d": [12.5, 335.5], "label": "normal sperm"}, {"point_2d": [238.5, 418.0], "label": "normal sperm"}, {"point_2d": [7.5, 390.0], "label": "normal sperm"}, {"point_2d": [403.5, 347.0], "label": "normal sperm"}, {"point_2d": [596.5, 305.0], "label": "normal sperm"}, {"point_2d": [626.5, 115.5], "label": "normal sperm"}, {"point_2d": [617.5, 406.5], "label": "normal sperm"}, {"point_2d": [37.0, 160.5], "label": "normal sperm"}]
```


[User] <image> Draw a bounding box around sperm.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [454.0, 238.0, 482.0, 266.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [20.0, 129.0, 47.0, 157.0], "label": "sperm"}, {"bbox_2d": [277.0, 421.0, 303.0, 446.0], "label": "sperm"}, {"bbox_2d": [0.0, 324.0, 25.0, 347.0], "label": "sperm"}, {"bbox_2d": [228.0, 408.0, 249.0, 428.0], "label": "sperm"}, {"bbox_2d": [0.0, 382.0, 15.0, 398.0], "label": "sperm"}, {"bbox_2d": [391.0, 335.0, 416.0, 359.0], "label": "sperm"}, {"bbox_2d": [585.0, 293.0, 608.0, 317.0], "label": "sperm"}, {"bbox_2d": [616.0, 106.0, 637.0, 125.0], "label": "sperm"}, {"bbox_2d": [605.0, 393.0, 630.0, 420.0], "label": "sperm"}, {"bbox_2d": [25.0, 150.0, 49.0, 171.0], "label": "sperm"}]
```


[User] <image> If you see any normal sperm in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 22, "label": "normal sperm"}
```


[User] <image> Show me each sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [468.0, 252.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [33.5, 143.0], [290.0, 433.5], [12.5, 335.5], [238.5, 418.0], [7.5, 390.0], [403.5, 347.0], [596.5, 305.0], [626.5, 115.5], [617.5, 406.5], [37.0, 160.5]], "label": "normal sperm"}
```


[User] <image> Provide the total number of sperm and for each, supply a bounding box.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [454.0, 238.0, 482.0, 266.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [20.0, 129.0, 47.0, 157.0], [277.0, 421.0, 303.0, 446.0], [0.0, 324.0, 25.0, 347.0], [228.0, 408.0, 249.0, 428.0], [0.0, 382.0, 15.0, 398.0], [391.0, 335.0, 416.0, 359.0], [585.0, 293.0, 608.0, 317.0], [616.0, 106.0, 637.0, 125.0], [605.0, 393.0, 630.0, 420.0], [25.0, 150.0, 49.0, 171.0]], "label": "normal sperm"}
```


[User] <image> Find the sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Find the region corresponding to cluster and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> How many sperm cluster do you see?

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Mark all visible sperm cluster in the image with a point and then provide the count.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Provide the total number of sperm cluster and for each, supply a bounding box.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> If there are any sperms in the image, show me where they are.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [459.0, 232.5], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [40.5, 172.0], "label": "sperm"}, {"point_2d": [298.0, 428.5], "label": "sperm"}, {"point_2d": [51.5, 328.0], "label": "sperm"}, {"point_2d": [206.0, 401.0], "label": "sperm"}, {"point_2d": [17.5, 415.0], "label": "sperm"}, {"point_2d": [329.0, 380.0], "label": "sperm"}, {"point_2d": [625.0, 344.5], "label": "sperm"}, {"point_2d": [622.5, 182.5], "label": "sperm"}, {"point_2d": [584.0, 462.0], "label": "sperm"}, {"point_2d": [39.0, 159.5], "label": "sperm"}]
```


[User] <image> Outline the normal sperm using a bounding box.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [445.0, 219.0, 473.0, 246.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [27.0, 158.0, 54.0, 186.0], "label": "normal sperm"}, {"bbox_2d": [284.0, 415.0, 312.0, 442.0], "label": "normal sperm"}, {"bbox_2d": [39.0, 317.0, 64.0, 339.0], "label": "normal sperm"}, {"bbox_2d": [195.0, 391.0, 217.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [10.0, 407.0, 25.0, 423.0], "label": "normal sperm"}, {"bbox_2d": [317.0, 370.0, 341.0, 390.0], "label": "normal sperm"}, {"bbox_2d": [615.0, 333.0, 635.0, 356.0], "label": "normal sperm"}, {"bbox_2d": [612.0, 173.0, 633.0, 192.0], "label": "normal sperm"}, {"bbox_2d": [572.0, 452.0, 596.0, 472.0], "label": "normal sperm"}, {"bbox_2d": [27.0, 149.0, 51.0, 170.0], "label": "normal sperm"}]
```


[User] <image> Point to all the visible sperm output the total count.

[Assistant]
```json
{"count": 22, "label": "sperm"}
```


[User] <image> Identify all occurrences of sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [459.0, 232.5], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [40.5, 172.0], [298.0, 428.5], [51.5, 328.0], [206.0, 401.0], [17.5, 415.0], [329.0, 380.0], [625.0, 344.5], [622.5, 182.5], [584.0, 462.0], [39.0, 159.5]], "label": "sperm"}
```


[User] <image> Mark all sperm with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [445.0, 219.0, 473.0, 246.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [27.0, 158.0, 54.0, 186.0], [284.0, 415.0, 312.0, 442.0], [39.0, 317.0, 64.0, 339.0], [195.0, 391.0, 217.0, 411.0], [10.0, 407.0, 25.0, 423.0], [317.0, 370.0, 341.0, 390.0], [615.0, 333.0, 635.0, 356.0], [612.0, 173.0, 633.0, 192.0], [572.0, 452.0, 596.0, 472.0], [27.0, 149.0, 51.0, 170.0]], "label": "sperm"}
```


[User] <image> Look for clusters in the image and show me where they are.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Locate the cluster and mark it with a bounding box in the image.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> Point to and count the sperm cluster in the picture.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Point out every cluster you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Output a list of bounding boxes for every cluster and the overall count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Locate every sperm.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [471.0, 252.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [34.5, 141.0], "label": "sperm"}, {"point_2d": [289.0, 433.5], "label": "sperm"}, {"point_2d": [12.5, 324.0], "label": "sperm"}, {"point_2d": [242.5, 420.0], "label": "sperm"}, {"point_2d": [7.5, 388.0], "label": "sperm"}, {"point_2d": [409.0, 345.0], "label": "sperm"}, {"point_2d": [593.0, 304.0], "label": "sperm"}, {"point_2d": [627.5, 111.5], "label": "sperm"}, {"point_2d": [618.5, 404.0], "label": "sperm"}, {"point_2d": [37.0, 160.5], "label": "sperm"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [457.0, 238.0, 485.0, 266.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [21.0, 127.0, 48.0, 155.0], "label": "sperm"}, {"bbox_2d": [276.0, 421.0, 302.0, 446.0], "label": "sperm"}, {"bbox_2d": [0.0, 313.0, 25.0, 335.0], "label": "sperm"}, {"bbox_2d": [232.0, 410.0, 253.0, 430.0], "label": "sperm"}, {"bbox_2d": [0.0, 380.0, 15.0, 396.0], "label": "sperm"}, {"bbox_2d": [397.0, 333.0, 421.0, 357.0], "label": "sperm"}, {"bbox_2d": [581.0, 292.0, 605.0, 316.0], "label": "sperm"}, {"bbox_2d": [617.0, 102.0, 638.0, 121.0], "label": "sperm"}, {"bbox_2d": [606.0, 391.0, 631.0, 417.0], "label": "sperm"}, {"bbox_2d": [25.0, 150.0, 49.0, 171.0], "label": "sperm"}]
```


[User] <image> Can you count the number of normal sperm in the image?

[Assistant]
```json
{"count": 22, "label": "normal sperm"}
```


[User] <image> Count the sperm in the image, then point to them.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [471.0, 252.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [34.5, 141.0], [289.0, 433.5], [12.5, 324.0], [242.5, 420.0], [7.5, 388.0], [409.0, 345.0], [593.0, 304.0], [627.5, 111.5], [618.5, 404.0], [37.0, 160.5]], "label": "normal sperm"}
```


[User] <image> Draw bounding boxes around every sperm and then provide the total count.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [457.0, 238.0, 485.0, 266.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [21.0, 127.0, 48.0, 155.0], [276.0, 421.0, 302.0, 446.0], [0.0, 313.0, 25.0, 335.0], [232.0, 410.0, 253.0, 430.0], [0.0, 380.0, 15.0, 396.0], [397.0, 333.0, 421.0, 357.0], [581.0, 292.0, 605.0, 316.0], [617.0, 102.0, 638.0, 121.0], [606.0, 391.0, 631.0, 417.0], [25.0, 150.0, 49.0, 171.0]], "label": "normal sperm"}
```


[User]
<image> Point to cluster.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Provide a bounding box that tightly encloses the cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> How many sperm cluster.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Find each cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Draw bounding boxes around every cluster and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> Can you see any normal sperms in the image? Point to them.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [474.0, 252.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [35.5, 139.0], "label": "normal sperm"}, {"point_2d": [289.0, 433.5], "label": "normal sperm"}, {"point_2d": [12.5, 324.0], "label": "normal sperm"}, {"point_2d": [242.5, 416.0], "label": "normal sperm"}, {"point_2d": [7.5, 386.0], "label": "normal sperm"}, {"point_2d": [414.0, 344.0], "label": "normal sperm"}, {"point_2d": [590.0, 302.0], "label": "normal sperm"}, {"point_2d": [629.5, 108.5], "label": "normal sperm"}, {"point_2d": [618.5, 400.5], "label": "normal sperm"}, {"point_2d": [37.0, 160.5], "label": "normal sperm"}]
```


[User] <image> Mark the object normal sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 238.0, 488.0, 266.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [22.0, 125.0, 49.0, 153.0], "label": "normal sperm"}, {"bbox_2d": [276.0, 421.0, 302.0, 446.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 313.0, 25.0, 335.0], "label": "normal sperm"}, {"bbox_2d": [232.0, 406.0, 253.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 378.0, 15.0, 394.0], "label": "normal sperm"}, {"bbox_2d": [402.0, 332.0, 426.0, 356.0], "label": "normal sperm"}, {"bbox_2d": [578.0, 290.0, 602.0, 314.0], "label": "normal sperm"}, {"bbox_2d": [619.0, 99.0, 640.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [606.0, 387.0, 631.0, 414.0], "label": "normal sperm"}, {"bbox_2d": [25.0, 150.0, 49.0, 171.0], "label": "normal sperm"}]
```


[User] <image> Tell me where each sperm is.

[Assistant]
```json
{"count": 22, "label": "sperm"}
```


[User] <image> Point to and count the sperm in the picture.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [474.0, 252.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [35.5, 139.0], [289.0, 433.5], [12.5, 324.0], [242.5, 416.0], [7.5, 386.0], [414.0, 344.0], [590.0, 302.0], [629.5, 108.5], [618.5, 400.5], [37.0, 160.5]], "label": "sperm"}
```


[User] <image> Draw bounding boxes around every sperm and then provide the total count.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [460.0, 238.0, 488.0, 266.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [22.0, 125.0, 49.0, 153.0], [276.0, 421.0, 302.0, 446.0], [0.0, 313.0, 25.0, 335.0], [232.0, 406.0, 253.0, 426.0], [0.0, 378.0, 15.0, 394.0], [402.0, 332.0, 426.0, 356.0], [578.0, 290.0, 602.0, 314.0], [619.0, 99.0, 640.0, 118.0], [606.0, 387.0, 631.0, 414.0], [25.0, 150.0, 49.0, 171.0]], "label": "sperm"}
```


[User] <image> If there are any clusters present, indicate their positions.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Enclose cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "cluster"}]
```


[User] <image> How many cluster.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Mark all visible cluster in the image with a point and then provide the count.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Count all cluster in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Locate every normal sperm.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [450.0, 246.5], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [27.5, 156.0], "label": "normal sperm"}, {"point_2d": [293.5, 434.0], "label": "normal sperm"}, {"point_2d": [18.5, 327.0], "label": "normal sperm"}, {"point_2d": [216.0, 406.0], "label": "normal sperm"}, {"point_2d": [10.5, 398.0], "label": "normal sperm"}, {"point_2d": [376.0, 359.0], "label": "normal sperm"}, {"point_2d": [609.0, 319.5], "label": "normal sperm"}, {"point_2d": [623.5, 136.5], "label": "normal sperm"}, {"point_2d": [605.0, 429.0], "label": "normal sperm"}, {"point_2d": [38.0, 160.5], "label": "normal sperm"}]
```


[User] <image> Identify the sperm in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [436.0, 232.0, 464.0, 261.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [14.0, 142.0, 41.0, 170.0], "label": "sperm"}, {"bbox_2d": [280.0, 421.0, 307.0, 447.0], "label": "sperm"}, {"bbox_2d": [6.0, 316.0, 31.0, 338.0], "label": "sperm"}, {"bbox_2d": [205.0, 396.0, 227.0, 416.0], "label": "sperm"}, {"bbox_2d": [3.0, 390.0, 18.0, 406.0], "label": "sperm"}, {"bbox_2d": [364.0, 347.0, 388.0, 371.0], "label": "sperm"}, {"bbox_2d": [599.0, 308.0, 619.0, 331.0], "label": "sperm"}, {"bbox_2d": [613.0, 127.0, 634.0, 146.0], "label": "sperm"}, {"bbox_2d": [593.0, 419.0, 617.0, 439.0], "label": "sperm"}, {"bbox_2d": [26.0, 150.0, 50.0, 171.0], "label": "sperm"}]
```


[User] <image> Point to and count the normal sperm in the picture.

[Assistant]
```json
{"count": 22, "label": "normal sperm"}
```


[User] <image> How many normal sperm are there? Point to them.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [450.0, 246.5], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [27.5, 156.0], [293.5, 434.0], [18.5, 327.0], [216.0, 406.0], [10.5, 398.0], [376.0, 359.0], [609.0, 319.5], [623.5, 136.5], [605.0, 429.0], [38.0, 160.5]], "label": "normal sperm"}
```


[User] <image> Provide bounding box coordinates for each normal sperm and then specify the total count.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [436.0, 232.0, 464.0, 261.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [14.0, 142.0, 41.0, 170.0], [280.0, 421.0, 307.0, 447.0], [6.0, 316.0, 31.0, 338.0], [205.0, 396.0, 227.0, 416.0], [3.0, 390.0, 18.0, 406.0], [364.0, 347.0, 388.0, 371.0], [599.0, 308.0, 619.0, 331.0], [613.0, 127.0, 634.0, 146.0], [593.0, 419.0, 617.0, 439.0], [26.0, 150.0, 50.0, 171.0]], "label": "normal sperm"}
```


[User] <image> Point to every cluster

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Draw a bounding box around sperm cluster.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> Point at the sperm cluster and then count them.

[Assistant]
```json
{"count": 4, "label": "sperm cluster"}
```


[User] <image> Locate the cluster and count them, then point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "sperm cluster"}
```


[User] <image> Mark all cluster with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "sperm cluster"}
```


[User] <image> If there are any normal sperms present, indicate their positions.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [457.0, 252.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [30.5, 151.0], "label": "normal sperm"}, {"point_2d": [291.5, 434.0], "label": "normal sperm"}, {"point_2d": [12.5, 323.0], "label": "normal sperm"}, {"point_2d": [224.5, 411.0], "label": "normal sperm"}, {"point_2d": [8.5, 394.0], "label": "normal sperm"}, {"point_2d": [395.0, 355.0], "label": "normal sperm"}, {"point_2d": [610.0, 308.5], "label": "normal sperm"}, {"point_2d": [628.5, 126.5], "label": "normal sperm"}, {"point_2d": [609.5, 417.0], "label": "normal sperm"}, {"point_2d": [38.0, 160.5], "label": "normal sperm"}]
```


[User] <image> Identify normal sperm and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "normal sperm"}, {"bbox_2d": [443.0, 238.0, 471.0, 266.0], "label": "normal sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "normal sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "normal sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "normal sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "normal sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "normal sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "normal sperm"}, {"bbox_2d": [17.0, 137.0, 44.0, 165.0], "label": "normal sperm"}, {"bbox_2d": [278.0, 421.0, 305.0, 447.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 312.0, 25.0, 334.0], "label": "normal sperm"}, {"bbox_2d": [214.0, 401.0, 235.0, 421.0], "label": "normal sperm"}, {"bbox_2d": [1.0, 386.0, 16.0, 402.0], "label": "normal sperm"}, {"bbox_2d": [383.0, 343.0, 407.0, 367.0], "label": "normal sperm"}, {"bbox_2d": [600.0, 297.0, 620.0, 320.0], "label": "normal sperm"}, {"bbox_2d": [618.0, 117.0, 639.0, 136.0], "label": "normal sperm"}, {"bbox_2d": [597.0, 404.0, 622.0, 430.0], "label": "normal sperm"}, {"bbox_2d": [26.0, 150.0, 50.0, 171.0], "label": "normal sperm"}]
```


[User] <image> Locate every sperm and count them

[Assistant]
```json
{"count": 22, "label": "sperm"}
```


[User] <image> Count every sperm in the picture, then point to them.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [457.0, 252.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [30.5, 151.0], [291.5, 434.0], [12.5, 323.0], [224.5, 411.0], [8.5, 394.0], [395.0, 355.0], [610.0, 308.5], [628.5, 126.5], [609.5, 417.0], [38.0, 160.5]], "label": "sperm"}
```


[User] <image> Locate all instances of sperm, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [443.0, 238.0, 471.0, 266.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [17.0, 137.0, 44.0, 165.0], [278.0, 421.0, 305.0, 447.0], [0.0, 312.0, 25.0, 334.0], [214.0, 401.0, 235.0, 421.0], [1.0, 386.0, 16.0, 402.0], [383.0, 343.0, 407.0, 367.0], [600.0, 297.0, 620.0, 320.0], [618.0, 117.0, 639.0, 136.0], [597.0, 404.0, 622.0, 430.0], [26.0, 150.0, 50.0, 171.0]], "label": "sperm"}
```


[User] <image> show me all visible clusters

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Specify the bounding box for the sperm cluster in the image.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> How many cluster.

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> How many cluster are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Find all cluster in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> If there is a sperm present, indicate its position.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "sperm"}, {"point_2d": [327.5, 91.0], "label": "sperm"}, {"point_2d": [451.0, 247.0], "label": "sperm"}, {"point_2d": [16.0, 180.0], "label": "sperm"}, {"point_2d": [169.5, 275.0], "label": "sperm"}, {"point_2d": [470.0, 258.5], "label": "sperm"}, {"point_2d": [278.0, 458.5], "label": "sperm"}, {"point_2d": [181.0, 401.0], "label": "sperm"}, {"point_2d": [601.0, 97.5], "label": "sperm"}, {"point_2d": [569.0, 358.0], "label": "sperm"}, {"point_2d": [366.0, 430.0], "label": "sperm"}, {"point_2d": [265.0, 450.5], "label": "sperm"}, {"point_2d": [26.5, 157.0], "label": "sperm"}, {"point_2d": [294.5, 434.0], "label": "sperm"}, {"point_2d": [20.5, 327.0], "label": "sperm"}, {"point_2d": [213.5, 410.0], "label": "sperm"}, {"point_2d": [10.5, 399.0], "label": "sperm"}, {"point_2d": [374.0, 361.0], "label": "sperm"}, {"point_2d": [609.0, 322.5], "label": "sperm"}, {"point_2d": [620.5, 138.5], "label": "sperm"}, {"point_2d": [603.0, 431.0], "label": "sperm"}, {"point_2d": [38.0, 160.5], "label": "sperm"}]
```


[User] <image> Find the region corresponding to sperm and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [437.0, 233.0, 465.0, 261.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [13.0, 143.0, 40.0, 171.0], "label": "sperm"}, {"bbox_2d": [281.0, 421.0, 308.0, 447.0], "label": "sperm"}, {"bbox_2d": [8.0, 316.0, 33.0, 338.0], "label": "sperm"}, {"bbox_2d": [203.0, 400.0, 224.0, 420.0], "label": "sperm"}, {"bbox_2d": [3.0, 391.0, 18.0, 407.0], "label": "sperm"}, {"bbox_2d": [362.0, 349.0, 386.0, 373.0], "label": "sperm"}, {"bbox_2d": [599.0, 311.0, 619.0, 334.0], "label": "sperm"}, {"bbox_2d": [610.0, 129.0, 631.0, 148.0], "label": "sperm"}, {"bbox_2d": [591.0, 421.0, 615.0, 441.0], "label": "sperm"}, {"bbox_2d": [26.0, 150.0, 50.0, 171.0], "label": "sperm"}]
```


[User] <image> Show me where the sperm are and output the total count.

[Assistant]
```json
{"count": 22, "label": "sperm"}
```


[User] <image> Find all the normal sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [451.0, 247.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [26.5, 157.0], [294.5, 434.0], [20.5, 327.0], [213.5, 410.0], [10.5, 399.0], [374.0, 361.0], [609.0, 322.5], [620.5, 138.5], [603.0, 431.0], [38.0, 160.5]], "label": "sperm"}
```


[User] <image> Detect all normal sperm in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [437.0, 233.0, 465.0, 261.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [13.0, 143.0, 40.0, 171.0], [281.0, 421.0, 308.0, 447.0], [8.0, 316.0, 33.0, 338.0], [203.0, 400.0, 224.0, 420.0], [3.0, 391.0, 18.0, 407.0], [362.0, 349.0, 386.0, 373.0], [599.0, 311.0, 619.0, 334.0], [610.0, 129.0, 631.0, 148.0], [591.0, 421.0, 615.0, 441.0], [26.0, 150.0, 50.0, 171.0]], "label": "sperm"}
```


[User] <image> If there is a cluster present, indicate its position.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "cluster"}, {"point_2d": [602.0, 460.5], "label": "cluster"}, {"point_2d": [63.0, 204.0], "label": "cluster"}, {"point_2d": [281.0, 456.5], "label": "cluster"}]
```


[User] <image> Identify sperm cluster and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> how mmny cluster?

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Mark each sperm cluster with a point, then output how many there are.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Identify each sperm cluster by its bounding box, and then provide the total count.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> If there is a normal sperm present, indicate its position.

[Assistant]
```json
[{"point_2d": [98.0, 177.0], "label": "normal sperm"}, {"point_2d": [327.5, 91.0], "label": "normal sperm"}, {"point_2d": [465.0, 252.0], "label": "normal sperm"}, {"point_2d": [16.0, 180.0], "label": "normal sperm"}, {"point_2d": [169.5, 275.0], "label": "normal sperm"}, {"point_2d": [470.0, 258.5], "label": "normal sperm"}, {"point_2d": [278.0, 458.5], "label": "normal sperm"}, {"point_2d": [181.0, 401.0], "label": "normal sperm"}, {"point_2d": [601.0, 97.5], "label": "normal sperm"}, {"point_2d": [569.0, 358.0], "label": "normal sperm"}, {"point_2d": [366.0, 430.0], "label": "normal sperm"}, {"point_2d": [265.0, 450.5], "label": "normal sperm"}, {"point_2d": [32.5, 145.0], "label": "normal sperm"}, {"point_2d": [290.0, 433.5], "label": "normal sperm"}, {"point_2d": [14.0, 335.0], "label": "normal sperm"}, {"point_2d": [234.5, 416.0], "label": "normal sperm"}, {"point_2d": [7.5, 391.0], "label": "normal sperm"}, {"point_2d": [403.0, 346.0], "label": "normal sperm"}, {"point_2d": [600.0, 305.5], "label": "normal sperm"}, {"point_2d": [626.5, 118.5], "label": "normal sperm"}, {"point_2d": [615.5, 408.5], "label": "normal sperm"}, {"point_2d": [37.0, 160.5], "label": "normal sperm"}]
```


[User] <image> Outline the area containing sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [89.0, 167.0, 107.0, 187.0], "label": "sperm"}, {"bbox_2d": [315.0, 80.0, 340.0, 102.0], "label": "sperm"}, {"bbox_2d": [451.0, 238.0, 479.0, 266.0], "label": "sperm"}, {"bbox_2d": [6.0, 170.0, 26.0, 190.0], "label": "sperm"}, {"bbox_2d": [159.0, 267.0, 180.0, 283.0], "label": "sperm"}, {"bbox_2d": [460.0, 247.0, 480.0, 270.0], "label": "sperm"}, {"bbox_2d": [268.0, 448.0, 288.0, 469.0], "label": "sperm"}, {"bbox_2d": [168.0, 391.0, 194.0, 411.0], "label": "sperm"}, {"bbox_2d": [589.0, 83.0, 613.0, 112.0], "label": "sperm"}, {"bbox_2d": [551.0, 342.0, 587.0, 374.0], "label": "sperm"}, {"bbox_2d": [358.0, 422.0, 374.0, 438.0], "label": "sperm"}, {"bbox_2d": [254.0, 440.0, 276.0, 461.0], "label": "sperm"}, {"bbox_2d": [19.0, 131.0, 46.0, 159.0], "label": "sperm"}, {"bbox_2d": [277.0, 421.0, 303.0, 446.0], "label": "sperm"}, {"bbox_2d": [1.0, 324.0, 27.0, 346.0], "label": "sperm"}, {"bbox_2d": [224.0, 406.0, 245.0, 426.0], "label": "sperm"}, {"bbox_2d": [0.0, 383.0, 15.0, 399.0], "label": "sperm"}, {"bbox_2d": [391.0, 334.0, 415.0, 358.0], "label": "sperm"}, {"bbox_2d": [589.0, 294.0, 611.0, 317.0], "label": "sperm"}, {"bbox_2d": [616.0, 109.0, 637.0, 128.0], "label": "sperm"}, {"bbox_2d": [603.0, 395.0, 628.0, 422.0], "label": "sperm"}, {"bbox_2d": [25.0, 150.0, 49.0, 171.0], "label": "sperm"}]
```


[User] <image> How many sperm.

[Assistant]
```json
{"count": 22, "label": "sperm"}
```


[User] <image> Point to all sperm in the image and then count them.

[Assistant]
```json
{"count": 22, "point_2d": [[98.0, 177.0], [327.5, 91.0], [465.0, 252.0], [16.0, 180.0], [169.5, 275.0], [470.0, 258.5], [278.0, 458.5], [181.0, 401.0], [601.0, 97.5], [569.0, 358.0], [366.0, 430.0], [265.0, 450.5], [32.5, 145.0], [290.0, 433.5], [14.0, 335.0], [234.5, 416.0], [7.5, 391.0], [403.0, 346.0], [600.0, 305.5], [626.5, 118.5], [615.5, 408.5], [37.0, 160.5]], "label": "sperm"}
```


[User] <image> Return bounding boxes for each sperm in the image and the total count.

[Assistant]
```json
{"count": 22, "bbox_2d": [[89.0, 167.0, 107.0, 187.0], [315.0, 80.0, 340.0, 102.0], [451.0, 238.0, 479.0, 266.0], [6.0, 170.0, 26.0, 190.0], [159.0, 267.0, 180.0, 283.0], [460.0, 247.0, 480.0, 270.0], [268.0, 448.0, 288.0, 469.0], [168.0, 391.0, 194.0, 411.0], [589.0, 83.0, 613.0, 112.0], [551.0, 342.0, 587.0, 374.0], [358.0, 422.0, 374.0, 438.0], [254.0, 440.0, 276.0, 461.0], [19.0, 131.0, 46.0, 159.0], [277.0, 421.0, 303.0, 446.0], [1.0, 324.0, 27.0, 346.0], [224.0, 406.0, 245.0, 426.0], [0.0, 383.0, 15.0, 399.0], [391.0, 334.0, 415.0, 358.0], [589.0, 294.0, 611.0, 317.0], [616.0, 109.0, 637.0, 128.0], [603.0, 395.0, 628.0, 422.0], [25.0, 150.0, 49.0, 171.0]], "label": "sperm"}
```


[User]
<image> Help me find an object in the image by pointing to it.
Object: sperm cluster.

[Assistant]
```json
[{"point_2d": [532.0, 458.5], "label": "sperm cluster"}, {"point_2d": [602.0, 460.5], "label": "sperm cluster"}, {"point_2d": [63.0, 204.0], "label": "sperm cluster"}, {"point_2d": [281.0, 456.5], "label": "sperm cluster"}]
```


[User] <image> Enclose sperm cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [511.0, 437.0, 553.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [580.0, 441.0, 624.0, 480.0], "label": "sperm cluster"}, {"bbox_2d": [20.0, 161.0, 106.0, 247.0], "label": "sperm cluster"}, {"bbox_2d": [253.0, 435.0, 309.0, 478.0], "label": "sperm cluster"}]
```


[User] <image> If you see any cluster in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 4, "label": "cluster"}
```


[User] <image> Find each cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 4, "point_2d": [[532.0, 458.5], [602.0, 460.5], [63.0, 204.0], [281.0, 456.5]], "label": "cluster"}
```


[User] <image> Output the total count of cluster in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 4, "bbox_2d": [[511.0, 437.0, 553.0, 480.0], [580.0, 441.0, 624.0, 480.0], [20.0, 161.0, 106.0, 247.0], [253.0, 435.0, 309.0, 478.0]], "label": "cluster"}
```


[User] <image> Outline the area containing sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [110.0, 72.0, 126.0, 88.0], "label": "sperm"}, {"bbox_2d": [156.0, 38.0, 175.0, 57.0], "label": "sperm"}, {"bbox_2d": [122.0, 105.0, 142.0, 128.0], "label": "sperm"}, {"bbox_2d": [400.0, 121.0, 429.0, 144.0], "label": "sperm"}, {"bbox_2d": [41.0, 169.0, 64.0, 193.0], "label": "sperm"}, {"bbox_2d": [224.0, 448.0, 246.0, 465.0], "label": "sperm"}, {"bbox_2d": [223.0, 468.0, 244.0, 480.0], "label": "sperm"}, {"bbox_2d": [310.0, 468.0, 330.0, 480.0], "label": "sperm"}, {"bbox_2d": [519.0, 311.0, 540.0, 335.0], "label": "sperm"}, {"bbox_2d": [485.0, 172.0, 500.0, 187.0], "label": "sperm"}, {"bbox_2d": [560.0, 206.0, 585.0, 230.0], "label": "sperm"}, {"bbox_2d": [499.0, 121.0, 522.0, 147.0], "label": "sperm"}, {"bbox_2d": [611.0, 65.0, 631.0, 85.0], "label": "sperm"}, {"bbox_2d": [510.0, 46.0, 533.0, 65.0], "label": "sperm"}, {"bbox_2d": [604.0, 0.0, 628.0, 19.0], "label": "sperm"}, {"bbox_2d": [480.0, 74.0, 504.0, 96.0], "label": "sperm"}, {"bbox_2d": [141.0, 303.0, 166.0, 327.0], "label": "sperm"}, {"bbox_2d": [126.0, 464.0, 151.0, 477.0], "label": "sperm"}, {"bbox_2d": [123.0, 294.0, 145.0, 317.0], "label": "sperm"}, {"bbox_2d": [41.0, 5.0, 62.0, 24.0], "label": "sperm"}, {"bbox_2d": [298.0, 107.0, 337.0, 146.0], "label": "sperm"}]
```


[User] <image> How many normal sperm are there in the image?

[Assistant]
```json
{"count": 21, "label": "normal sperm"}
```


[User] <image> Point to all sperm in the image and then count them.

[Assistant]
```json
{"count": 21, "point_2d": [[118.0, 80.0], [165.5, 47.5], [132.0, 116.5], [414.5, 132.5], [52.5, 181.0], [235.0, 456.5], [233.5, 474.0], [320.0, 474.0], [529.5, 323.0], [492.5, 179.5], [572.5, 218.0], [510.5, 134.0], [621.0, 75.0], [521.5, 55.5], [616.0, 9.5], [492.0, 85.0], [153.5, 315.0], [138.5, 470.5], [134.0, 305.5], [51.5, 14.5], [317.5, 126.5]], "label": "normal sperm"}
```


[User] <image> Locate all instances of sperm, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 21, "bbox_2d": [[110.0, 72.0, 126.0, 88.0], [156.0, 38.0, 175.0, 57.0], [122.0, 105.0, 142.0, 128.0], [400.0, 121.0, 429.0, 144.0], [41.0, 169.0, 64.0, 193.0], [224.0, 448.0, 246.0, 465.0], [223.0, 468.0, 244.0, 480.0], [310.0, 468.0, 330.0, 480.0], [519.0, 311.0, 540.0, 335.0], [485.0, 172.0, 500.0, 187.0], [560.0, 206.0, 585.0, 230.0], [499.0, 121.0, 522.0, 147.0], [611.0, 65.0, 631.0, 85.0], [510.0, 46.0, 533.0, 65.0], [604.0, 0.0, 628.0, 19.0], [480.0, 74.0, 504.0, 96.0], [141.0, 303.0, 166.0, 327.0], [126.0, 464.0, 151.0, 477.0], [123.0, 294.0, 145.0, 317.0], [41.0, 5.0, 62.0, 24.0], [298.0, 107.0, 337.0, 146.0]], "label": "normal sperm"}
```


[User] <image> Locate an pinhead.

[Assistant]
```json
[{"point_2d": [191.5, 50.0], "label": "pinhead"}, {"point_2d": [275.5, 169.5], "label": "pinhead"}, {"point_2d": [34.5, 195.0], "label": "pinhead"}]
```


[User] <image> Mark the pinhead sperm with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [180.0, 39.0, 203.0, 61.0], "label": "pinhead sperm"}, {"bbox_2d": [266.0, 159.0, 285.0, 180.0], "label": "pinhead sperm"}, {"bbox_2d": [28.0, 187.0, 41.0, 203.0], "label": "pinhead sperm"}]
```


[User] <image> find any pinhead in the picture and output the total count.

[Assistant]
```json
{"count": 3, "label": "pinhead"}
```


[User] <image> Show me each pinhead sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 3, "point_2d": [[191.5, 50.0], [275.5, 169.5], [34.5, 195.0]], "label": "pinhead"}
```


[User] <image> Return bounding boxes for each pinhead sperm in the image and the total count.

[Assistant]
```json
{"count": 3, "bbox_2d": [[180.0, 39.0, 203.0, 61.0], [266.0, 159.0, 285.0, 180.0], [28.0, 187.0, 41.0, 203.0]], "label": "pinhead"}
```


[User] <image> Locate an normal sperm.

[Assistant]
```json
[{"point_2d": [117.0, 80.0], "label": "normal sperm"}, {"point_2d": [165.0, 47.0], "label": "normal sperm"}, {"point_2d": [131.0, 115.5], "label": "normal sperm"}, {"point_2d": [413.5, 131.5], "label": "normal sperm"}, {"point_2d": [11.5, 163.5], "label": "normal sperm"}, {"point_2d": [288.0, 471.5], "label": "normal sperm"}, {"point_2d": [509.5, 344.0], "label": "normal sperm"}, {"point_2d": [493.0, 178.5], "label": "normal sperm"}, {"point_2d": [579.5, 212.5], "label": "normal sperm"}, {"point_2d": [510.5, 134.0], "label": "normal sperm"}, {"point_2d": [621.0, 74.0], "label": "normal sperm"}, {"point_2d": [520.5, 55.5], "label": "normal sperm"}, {"point_2d": [491.0, 85.0], "label": "normal sperm"}, {"point_2d": [153.5, 315.0], "label": "normal sperm"}, {"point_2d": [138.5, 470.5], "label": "normal sperm"}, {"point_2d": [133.5, 305.0], "label": "normal sperm"}, {"point_2d": [253.0, 475.0], "label": "normal sperm"}, {"point_2d": [51.5, 14.0], "label": "normal sperm"}, {"point_2d": [317.5, 126.5], "label": "normal sperm"}]
```


[User] <image> Specify the bounding box for the normal sperm in the image.

[Assistant]
```json
[{"bbox_2d": [109.0, 72.0, 125.0, 88.0], "label": "normal sperm"}, {"bbox_2d": [155.0, 37.0, 175.0, 57.0], "label": "normal sperm"}, {"bbox_2d": [121.0, 104.0, 141.0, 127.0], "label": "normal sperm"}, {"bbox_2d": [399.0, 120.0, 428.0, 143.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 152.0, 23.0, 175.0], "label": "normal sperm"}, {"bbox_2d": [277.0, 463.0, 299.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [499.0, 332.0, 520.0, 356.0], "label": "normal sperm"}, {"bbox_2d": [485.0, 171.0, 501.0, 186.0], "label": "normal sperm"}, {"bbox_2d": [567.0, 201.0, 592.0, 224.0], "label": "normal sperm"}, {"bbox_2d": [499.0, 121.0, 522.0, 147.0], "label": "normal sperm"}, {"bbox_2d": [611.0, 64.0, 631.0, 84.0], "label": "normal sperm"}, {"bbox_2d": [509.0, 46.0, 532.0, 65.0], "label": "normal sperm"}, {"bbox_2d": [479.0, 74.0, 503.0, 96.0], "label": "normal sperm"}, {"bbox_2d": [141.0, 303.0, 166.0, 327.0], "label": "normal sperm"}, {"bbox_2d": [126.0, 463.0, 151.0, 478.0], "label": "normal sperm"}, {"bbox_2d": [123.0, 294.0, 144.0, 316.0], "label": "normal sperm"}, {"bbox_2d": [243.0, 470.0, 263.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [41.0, 4.0, 62.0, 24.0], "label": "normal sperm"}, {"bbox_2d": [298.0, 107.0, 337.0, 146.0], "label": "normal sperm"}]
```


[User] <image> count each normal sperm

[Assistant]
```json
{"count": 19, "label": "normal sperm"}
```


[User] <image> Count the normal sperm in the image, then point to them.

[Assistant]
```json
{"count": 19, "point_2d": [[117.0, 80.0], [165.0, 47.0], [131.0, 115.5], [413.5, 131.5], [11.5, 163.5], [288.0, 471.5], [509.5, 344.0], [493.0, 178.5], [579.5, 212.5], [510.5, 134.0], [621.0, 74.0], [520.5, 55.5], [491.0, 85.0], [153.5, 315.0], [138.5, 470.5], [133.5, 305.0], [253.0, 475.0], [51.5, 14.0], [317.5, 126.5]], "label": "normal sperm"}
```


[User] <image> Count the normal sperm and enclose each in a bounding box.

[Assistant]
```json
{"count": 19, "bbox_2d": [[109.0, 72.0, 125.0, 88.0], [155.0, 37.0, 175.0, 57.0], [121.0, 104.0, 141.0, 127.0], [399.0, 120.0, 428.0, 143.0], [0.0, 152.0, 23.0, 175.0], [277.0, 463.0, 299.0, 480.0], [499.0, 332.0, 520.0, 356.0], [485.0, 171.0, 501.0, 186.0], [567.0, 201.0, 592.0, 224.0], [499.0, 121.0, 522.0, 147.0], [611.0, 64.0, 631.0, 84.0], [509.0, 46.0, 532.0, 65.0], [479.0, 74.0, 503.0, 96.0], [141.0, 303.0, 166.0, 327.0], [126.0, 463.0, 151.0, 478.0], [123.0, 294.0, 144.0, 316.0], [243.0, 470.0, 263.0, 480.0], [41.0, 4.0, 62.0, 24.0], [298.0, 107.0, 337.0, 146.0]], "label": "normal sperm"}
```


[User] <image> Can you show me where the pinheads are?

[Assistant]
```json
[{"point_2d": [167.0, 82.0], "label": "pinhead"}, {"point_2d": [274.5, 168.5], "label": "pinhead"}, {"point_2d": [34.5, 195.0], "label": "pinhead"}]
```


[User] <image> Provide a bounding box that tightly encloses the pinhead.

[Assistant]
```json
[{"bbox_2d": [156.0, 71.0, 178.0, 93.0], "label": "pinhead"}, {"bbox_2d": [265.0, 158.0, 284.0, 179.0], "label": "pinhead"}, {"bbox_2d": [28.0, 187.0, 41.0, 203.0], "label": "pinhead"}]
```


[User] <image> How many pinhead sperm are there?

[Assistant]
```json
{"count": 3, "label": "pinhead sperm"}
```