[User]
<image> Object: normal sperm
Instruction: Point to the object.

[Assistant]
```json
[{"point_2d": [171.5, 207.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [154.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [12.5, 359.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [145.5, 88.0], "label": "normal sperm"}, {"point_2d": [167.5, 61.0], "label": "normal sperm"}, {"point_2d": [180.5, 105.0], "label": "normal sperm"}, {"point_2d": [186.5, 157.0], "label": "normal sperm"}, {"point_2d": [120.0, 257.0], "label": "normal sperm"}, {"point_2d": [351.5, 451.0], "label": "normal sperm"}, {"point_2d": [408.5, 277.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [540.5, 407.0], "label": "normal sperm"}, {"point_2d": [534.5, 467.0], "label": "normal sperm"}, {"point_2d": [545.5, 360.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [554.0, 196.5], "label": "normal sperm"}, {"point_2d": [424.5, 82.0], "label": "normal sperm"}, {"point_2d": [494.5, 37.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [370.5, 247.0], "label": "normal sperm"}, {"point_2d": [314.5, 194.0], "label": "normal sperm"}, {"point_2d": [5.0, 138.0], "label": "normal sperm"}, {"point_2d": [268.0, 215.0], "label": "normal sperm"}, {"point_2d": [487.5, 136.0], "label": "normal sperm"}, {"point_2d": [628.0, 397.5], "label": "normal sperm"}, {"point_2d": [519.5, 454.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [71.5, 96.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [320.5, 352.5], "label": "normal sperm"}, {"point_2d": [289.5, 8.0], "label": "normal sperm"}, {"point_2d": [319.0, 9.5], "label": "normal sperm"}, {"point_2d": [214.0, 39.0], "label": "normal sperm"}, {"point_2d": [333.5, 4.5], "label": "normal sperm"}, {"point_2d": [235.5, 5.0], "label": "normal sperm"}]
```


[User] <image> Generate bounding box coordinates for the normal sperm.

[Assistant]
```json
[{"bbox_2d": [163.0, 198.0, 180.0, 216.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [4.0, 350.0, 21.0, 368.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [137.0, 78.0, 154.0, 98.0], "label": "normal sperm"}, {"bbox_2d": [159.0, 52.0, 176.0, 70.0], "label": "normal sperm"}, {"bbox_2d": [172.0, 96.0, 189.0, 114.0], "label": "normal sperm"}, {"bbox_2d": [178.0, 148.0, 195.0, 166.0], "label": "normal sperm"}, {"bbox_2d": [111.0, 246.0, 129.0, 268.0], "label": "normal sperm"}, {"bbox_2d": [343.0, 442.0, 360.0, 460.0], "label": "normal sperm"}, {"bbox_2d": [400.0, 268.0, 417.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [532.0, 398.0, 549.0, 416.0], "label": "normal sperm"}, {"bbox_2d": [526.0, 458.0, 543.0, 476.0], "label": "normal sperm"}, {"bbox_2d": [537.0, 351.0, 554.0, 369.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [546.0, 187.0, 562.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [416.0, 74.0, 433.0, 90.0], "label": "normal sperm"}, {"bbox_2d": [486.0, 29.0, 503.0, 45.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [362.0, 239.0, 379.0, 255.0], "label": "normal sperm"}, {"bbox_2d": [306.0, 186.0, 323.0, 202.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 130.0, 10.0, 146.0], "label": "normal sperm"}, {"bbox_2d": [259.0, 206.0, 277.0, 224.0], "label": "normal sperm"}, {"bbox_2d": [479.0, 128.0, 496.0, 144.0], "label": "normal sperm"}, {"bbox_2d": [622.0, 389.0, 634.0, 406.0], "label": "normal sperm"}, {"bbox_2d": [509.0, 444.0, 530.0, 465.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [60.0, 85.0, 83.0, 107.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [307.0, 342.0, 334.0, 363.0], "label": "normal sperm"}, {"bbox_2d": [282.0, 2.0, 297.0, 14.0], "label": "normal sperm"}, {"bbox_2d": [311.0, 3.0, 327.0, 16.0], "label": "normal sperm"}, {"bbox_2d": [205.0, 30.0, 223.0, 48.0], "label": "normal sperm"}, {"bbox_2d": [324.0, 0.0, 343.0, 9.0], "label": "normal sperm"}, {"bbox_2d": [228.0, 0.0, 243.0, 10.0], "label": "normal sperm"}]
```


[User] <image> Locate the sperm and count them

[Assistant]
```json
{"count": 40, "label": "sperm"}
```


[User] <image> Count every sperm in the picture, then point to them.

[Assistant]
```json
{"count": 40, "point_2d": [[171.5, 207.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [12.5, 359.0], [86.5, 90.5], [145.5, 88.0], [167.5, 61.0], [180.5, 105.0], [186.5, 157.0], [120.0, 257.0], [351.5, 451.0], [408.5, 277.0], [312.5, 417.0], [540.5, 407.0], [534.5, 467.0], [545.5, 360.0], [530.0, 209.5], [554.0, 196.5], [424.5, 82.0], [494.5, 37.0], [454.5, 304.5], [370.5, 247.0], [314.5, 194.0], [5.0, 138.0], [268.0, 215.0], [487.5, 136.0], [628.0, 397.5], [519.5, 454.5], [376.0, 57.0], [385.0, 99.0], [71.5, 96.0], [548.0, 107.5], [320.5, 352.5], [289.5, 8.0], [319.0, 9.5], [214.0, 39.0], [333.5, 4.5], [235.5, 5.0]], "label": "sperm"}
```


[User] <image> Count every sperm and return a list of bounding boxes.

[Assistant]
```json
{"count": 40, "bbox_2d": [[163.0, 198.0, 180.0, 216.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [4.0, 350.0, 21.0, 368.0], [78.0, 82.0, 95.0, 99.0], [137.0, 78.0, 154.0, 98.0], [159.0, 52.0, 176.0, 70.0], [172.0, 96.0, 189.0, 114.0], [178.0, 148.0, 195.0, 166.0], [111.0, 246.0, 129.0, 268.0], [343.0, 442.0, 360.0, 460.0], [400.0, 268.0, 417.0, 286.0], [304.0, 408.0, 321.0, 426.0], [532.0, 398.0, 549.0, 416.0], [526.0, 458.0, 543.0, 476.0], [537.0, 351.0, 554.0, 369.0], [522.0, 200.0, 538.0, 219.0], [546.0, 187.0, 562.0, 206.0], [416.0, 74.0, 433.0, 90.0], [486.0, 29.0, 503.0, 45.0], [446.0, 296.0, 463.0, 313.0], [362.0, 239.0, 379.0, 255.0], [306.0, 186.0, 323.0, 202.0], [0.0, 130.0, 10.0, 146.0], [259.0, 206.0, 277.0, 224.0], [479.0, 128.0, 496.0, 144.0], [622.0, 389.0, 634.0, 406.0], [509.0, 444.0, 530.0, 465.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [60.0, 85.0, 83.0, 107.0], [536.0, 97.0, 560.0, 118.0], [307.0, 342.0, 334.0, 363.0], [282.0, 2.0, 297.0, 14.0], [311.0, 3.0, 327.0, 16.0], [205.0, 30.0, 223.0, 48.0], [324.0, 0.0, 343.0, 9.0], [228.0, 0.0, 243.0, 10.0]], "label": "sperm"}
```


[User] <image> Can you see any clusters in the image? Point to them.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Find the region corresponding to sperm cluster and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> Locate the cluster and count them

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> How many sperm cluster are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Outline all instances of sperm cluster with bounding boxes, then return the count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Find any normal sperms in the picture

[Assistant]
```json
[{"point_2d": [174.5, 201.0], "label": "normal sperm"}, {"point_2d": [152.5, 277.0], "label": "normal sperm"}, {"point_2d": [155.5, 409.0], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [16.5, 350.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [139.5, 73.0], "label": "normal sperm"}, {"point_2d": [189.5, 50.0], "label": "normal sperm"}, {"point_2d": [181.5, 104.0], "label": "normal sperm"}, {"point_2d": [199.5, 148.0], "label": "normal sperm"}, {"point_2d": [242.5, 136.0], "label": "normal sperm"}, {"point_2d": [368.5, 425.0], "label": "normal sperm"}, {"point_2d": [411.5, 272.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [437.5, 375.0], "label": "normal sperm"}, {"point_2d": [542.5, 403.0], "label": "normal sperm"}, {"point_2d": [536.5, 463.0], "label": "normal sperm"}, {"point_2d": [546.5, 359.0], "label": "normal sperm"}, {"point_2d": [630.5, 400.5], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [555.0, 196.5], "label": "normal sperm"}, {"point_2d": [404.5, 67.5], "label": "normal sperm"}, {"point_2d": [428.5, 68.0], "label": "normal sperm"}, {"point_2d": [493.5, 32.0], "label": "normal sperm"}, {"point_2d": [454.5, 305.0], "label": "normal sperm"}, {"point_2d": [377.5, 234.0], "label": "normal sperm"}, {"point_2d": [318.5, 186.0], "label": "normal sperm"}, {"point_2d": [6.0, 280.5], "label": "normal sperm"}, {"point_2d": [9.5, 113.0], "label": "normal sperm"}, {"point_2d": [115.0, 123.0], "label": "normal sperm"}, {"point_2d": [493.5, 328.0], "label": "normal sperm"}, {"point_2d": [633.5, 371.5], "label": "normal sperm"}, {"point_2d": [412.0, 214.0], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [164.0, 283.0], "label": "normal sperm"}, {"point_2d": [259.5, 253.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [326.5, 346.5], "label": "normal sperm"}]
```


[User] <image> Return the bounding box of the sperm.

[Assistant]
```json
[{"bbox_2d": [166.0, 192.0, 183.0, 210.0], "label": "sperm"}, {"bbox_2d": [144.0, 268.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [147.0, 400.0, 164.0, 418.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [8.0, 341.0, 25.0, 359.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [131.0, 64.0, 148.0, 82.0], "label": "sperm"}, {"bbox_2d": [181.0, 41.0, 198.0, 59.0], "label": "sperm"}, {"bbox_2d": [173.0, 95.0, 190.0, 113.0], "label": "sperm"}, {"bbox_2d": [191.0, 139.0, 208.0, 157.0], "label": "sperm"}, {"bbox_2d": [234.0, 126.0, 251.0, 146.0], "label": "sperm"}, {"bbox_2d": [360.0, 416.0, 377.0, 434.0], "label": "sperm"}, {"bbox_2d": [403.0, 263.0, 420.0, 281.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [430.0, 366.0, 445.0, 384.0], "label": "sperm"}, {"bbox_2d": [534.0, 394.0, 551.0, 412.0], "label": "sperm"}, {"bbox_2d": [528.0, 454.0, 545.0, 472.0], "label": "sperm"}, {"bbox_2d": [538.0, 350.0, 555.0, 368.0], "label": "sperm"}, {"bbox_2d": [622.0, 390.0, 639.0, 411.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [547.0, 187.0, 563.0, 206.0], "label": "sperm"}, {"bbox_2d": [397.0, 59.0, 412.0, 76.0], "label": "sperm"}, {"bbox_2d": [420.0, 60.0, 437.0, 76.0], "label": "sperm"}, {"bbox_2d": [485.0, 24.0, 502.0, 40.0], "label": "sperm"}, {"bbox_2d": [446.0, 297.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [369.0, 226.0, 386.0, 242.0], "label": "sperm"}, {"bbox_2d": [310.0, 178.0, 327.0, 194.0], "label": "sperm"}, {"bbox_2d": [0.0, 271.0, 12.0, 290.0], "label": "sperm"}, {"bbox_2d": [1.0, 105.0, 18.0, 121.0], "label": "sperm"}, {"bbox_2d": [106.0, 114.0, 124.0, 132.0], "label": "sperm"}, {"bbox_2d": [485.0, 320.0, 502.0, 336.0], "label": "sperm"}, {"bbox_2d": [628.0, 363.0, 639.0, 380.0], "label": "sperm"}, {"bbox_2d": [404.0, 206.0, 420.0, 222.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [153.0, 272.0, 175.0, 294.0], "label": "sperm"}, {"bbox_2d": [249.0, 244.0, 270.0, 262.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [313.0, 336.0, 340.0, 357.0], "label": "sperm"}]
```


[User] <image> Locate every normal sperm and count them

[Assistant]
```json
{"count": 40, "label": "normal sperm"}
```


[User] <image> How many sperm are there? Point to them.

[Assistant]
```json
{"count": 40, "point_2d": [[174.5, 201.0], [152.5, 277.0], [155.5, 409.0], [124.5, 406.0], [53.0, 387.0], [16.5, 350.0], [86.5, 90.5], [139.5, 73.0], [189.5, 50.0], [181.5, 104.0], [199.5, 148.0], [242.5, 136.0], [368.5, 425.0], [411.5, 272.0], [312.5, 417.0], [437.5, 375.0], [542.5, 403.0], [536.5, 463.0], [546.5, 359.0], [630.5, 400.5], [530.0, 209.5], [555.0, 196.5], [404.5, 67.5], [428.5, 68.0], [493.5, 32.0], [454.5, 305.0], [377.5, 234.0], [318.5, 186.0], [6.0, 280.5], [9.5, 113.0], [115.0, 123.0], [493.5, 328.0], [633.5, 371.5], [412.0, 214.0], [376.0, 57.0], [385.0, 99.0], [164.0, 283.0], [259.5, 253.0], [548.0, 107.5], [326.5, 346.5]], "label": "normal sperm"}
```


[User] <image> Mark each sperm with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 40, "bbox_2d": [[166.0, 192.0, 183.0, 210.0], [144.0, 268.0, 161.0, 286.0], [147.0, 400.0, 164.0, 418.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [8.0, 341.0, 25.0, 359.0], [78.0, 82.0, 95.0, 99.0], [131.0, 64.0, 148.0, 82.0], [181.0, 41.0, 198.0, 59.0], [173.0, 95.0, 190.0, 113.0], [191.0, 139.0, 208.0, 157.0], [234.0, 126.0, 251.0, 146.0], [360.0, 416.0, 377.0, 434.0], [403.0, 263.0, 420.0, 281.0], [304.0, 408.0, 321.0, 426.0], [430.0, 366.0, 445.0, 384.0], [534.0, 394.0, 551.0, 412.0], [528.0, 454.0, 545.0, 472.0], [538.0, 350.0, 555.0, 368.0], [622.0, 390.0, 639.0, 411.0], [522.0, 200.0, 538.0, 219.0], [547.0, 187.0, 563.0, 206.0], [397.0, 59.0, 412.0, 76.0], [420.0, 60.0, 437.0, 76.0], [485.0, 24.0, 502.0, 40.0], [446.0, 297.0, 463.0, 313.0], [369.0, 226.0, 386.0, 242.0], [310.0, 178.0, 327.0, 194.0], [0.0, 271.0, 12.0, 290.0], [1.0, 105.0, 18.0, 121.0], [106.0, 114.0, 124.0, 132.0], [485.0, 320.0, 502.0, 336.0], [628.0, 363.0, 639.0, 380.0], [404.0, 206.0, 420.0, 222.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [153.0, 272.0, 175.0, 294.0], [249.0, 244.0, 270.0, 262.0], [536.0, 97.0, 560.0, 118.0], [313.0, 336.0, 340.0, 357.0]], "label": "normal sperm"}
```


[User] <image> Point to all occurrences of "sperm clusters"

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Locate and mark sperm cluster with a bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> count every sperm cluster

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> How many cluster are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Mark each cluster with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Can you point out all normal sperms in this image?

[Assistant]
```json
[{"point_2d": [172.5, 206.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [154.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [13.5, 356.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [141.5, 87.5], "label": "normal sperm"}, {"point_2d": [172.5, 58.0], "label": "normal sperm"}, {"point_2d": [180.5, 105.0], "label": "normal sperm"}, {"point_2d": [189.5, 154.0], "label": "normal sperm"}, {"point_2d": [146.0, 225.0], "label": "normal sperm"}, {"point_2d": [355.5, 445.0], "label": "normal sperm"}, {"point_2d": [408.5, 275.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [540.5, 406.0], "label": "normal sperm"}, {"point_2d": [534.5, 466.0], "label": "normal sperm"}, {"point_2d": [545.5, 360.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [555.0, 196.5], "label": "normal sperm"}, {"point_2d": [425.5, 78.0], "label": "normal sperm"}, {"point_2d": [494.5, 35.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [373.5, 243.0], "label": "normal sperm"}, {"point_2d": [317.5, 194.0], "label": "normal sperm"}, {"point_2d": [7.0, 132.0], "label": "normal sperm"}, {"point_2d": [236.0, 211.0], "label": "normal sperm"}, {"point_2d": [499.5, 189.0], "label": "normal sperm"}, {"point_2d": [631.0, 391.5], "label": "normal sperm"}, {"point_2d": [496.5, 397.0], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [99.5, 152.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [321.5, 351.5], "label": "normal sperm"}, {"point_2d": [211.5, 29.0], "label": "normal sperm"}, {"point_2d": [318.0, 8.5], "label": "normal sperm"}, {"point_2d": [287.0, 3.5], "label": "normal sperm"}, {"point_2d": [335.5, 4.5], "label": "normal sperm"}]
```


[User] <image> Identify the sperm in the image and provide its bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [164.0, 197.0, 181.0, 215.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [5.0, 347.0, 22.0, 365.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [133.0, 77.0, 150.0, 98.0], "label": "sperm"}, {"bbox_2d": [164.0, 49.0, 181.0, 67.0], "label": "sperm"}, {"bbox_2d": [172.0, 96.0, 189.0, 114.0], "label": "sperm"}, {"bbox_2d": [181.0, 145.0, 198.0, 163.0], "label": "sperm"}, {"bbox_2d": [137.0, 214.0, 155.0, 236.0], "label": "sperm"}, {"bbox_2d": [347.0, 436.0, 364.0, 454.0], "label": "sperm"}, {"bbox_2d": [400.0, 266.0, 417.0, 284.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [532.0, 397.0, 549.0, 415.0], "label": "sperm"}, {"bbox_2d": [526.0, 457.0, 543.0, 475.0], "label": "sperm"}, {"bbox_2d": [537.0, 351.0, 554.0, 369.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [547.0, 187.0, 563.0, 206.0], "label": "sperm"}, {"bbox_2d": [417.0, 70.0, 434.0, 86.0], "label": "sperm"}, {"bbox_2d": [486.0, 27.0, 503.0, 43.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [365.0, 235.0, 382.0, 251.0], "label": "sperm"}, {"bbox_2d": [309.0, 186.0, 326.0, 202.0], "label": "sperm"}, {"bbox_2d": [0.0, 124.0, 14.0, 140.0], "label": "sperm"}, {"bbox_2d": [227.0, 202.0, 245.0, 220.0], "label": "sperm"}, {"bbox_2d": [491.0, 181.0, 508.0, 197.0], "label": "sperm"}, {"bbox_2d": [626.0, 383.0, 636.0, 400.0], "label": "sperm"}, {"bbox_2d": [487.0, 387.0, 506.0, 407.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [88.0, 141.0, 111.0, 163.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [308.0, 341.0, 335.0, 362.0], "label": "sperm"}, {"bbox_2d": [204.0, 22.0, 219.0, 36.0], "label": "sperm"}, {"bbox_2d": [310.0, 2.0, 326.0, 15.0], "label": "sperm"}, {"bbox_2d": [278.0, 0.0, 296.0, 7.0], "label": "sperm"}, {"bbox_2d": [326.0, 0.0, 345.0, 9.0], "label": "sperm"}]
```


[User] <image> Can you count every sperm in the picture?

[Assistant]
```json
{"count": 39, "label": "sperm"}
```


[User] <image> Count the sperm in the image, then point to them.

[Assistant]
```json
{"count": 39, "point_2d": [[172.5, 206.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [13.5, 356.0], [86.5, 90.5], [141.5, 87.5], [172.5, 58.0], [180.5, 105.0], [189.5, 154.0], [146.0, 225.0], [355.5, 445.0], [408.5, 275.0], [312.5, 417.0], [540.5, 406.0], [534.5, 466.0], [545.5, 360.0], [530.0, 209.5], [555.0, 196.5], [425.5, 78.0], [494.5, 35.0], [454.5, 304.5], [373.5, 243.0], [317.5, 194.0], [7.0, 132.0], [236.0, 211.0], [499.5, 189.0], [631.0, 391.5], [496.5, 397.0], [376.0, 57.0], [385.0, 99.0], [99.5, 152.0], [548.0, 107.5], [321.5, 351.5], [211.5, 29.0], [318.0, 8.5], [287.0, 3.5], [335.5, 4.5]], "label": "sperm"}
```


[User] <image> Return bounding boxes for each sperm in the image and the total count.

[Assistant]
```json
{"count": 39, "bbox_2d": [[164.0, 197.0, 181.0, 215.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [5.0, 347.0, 22.0, 365.0], [78.0, 82.0, 95.0, 99.0], [133.0, 77.0, 150.0, 98.0], [164.0, 49.0, 181.0, 67.0], [172.0, 96.0, 189.0, 114.0], [181.0, 145.0, 198.0, 163.0], [137.0, 214.0, 155.0, 236.0], [347.0, 436.0, 364.0, 454.0], [400.0, 266.0, 417.0, 284.0], [304.0, 408.0, 321.0, 426.0], [532.0, 397.0, 549.0, 415.0], [526.0, 457.0, 543.0, 475.0], [537.0, 351.0, 554.0, 369.0], [522.0, 200.0, 538.0, 219.0], [547.0, 187.0, 563.0, 206.0], [417.0, 70.0, 434.0, 86.0], [486.0, 27.0, 503.0, 43.0], [446.0, 296.0, 463.0, 313.0], [365.0, 235.0, 382.0, 251.0], [309.0, 186.0, 326.0, 202.0], [0.0, 124.0, 14.0, 140.0], [227.0, 202.0, 245.0, 220.0], [491.0, 181.0, 508.0, 197.0], [626.0, 383.0, 636.0, 400.0], [487.0, 387.0, 506.0, 407.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [88.0, 141.0, 111.0, 163.0], [536.0, 97.0, 560.0, 118.0], [308.0, 341.0, 335.0, 362.0], [204.0, 22.0, 219.0, 36.0], [310.0, 2.0, 326.0, 15.0], [278.0, 0.0, 296.0, 7.0], [326.0, 0.0, 345.0, 9.0]], "label": "sperm"}
```


[User] <image> Find the "sperm cluster".

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Provide the coordinates of a bounding box that encloses the cluster.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> count sperm cluster

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Point to and count the cluster in the picture.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Count the cluster and enclose each in a bounding box.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> I am looking for sperms. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [171.5, 207.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [154.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [12.5, 358.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [141.5, 89.0], "label": "sperm"}, {"point_2d": [168.5, 60.0], "label": "sperm"}, {"point_2d": [180.5, 105.0], "label": "sperm"}, {"point_2d": [186.5, 157.0], "label": "sperm"}, {"point_2d": [131.0, 254.0], "label": "sperm"}, {"point_2d": [351.5, 450.0], "label": "sperm"}, {"point_2d": [408.5, 277.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [540.5, 407.0], "label": "sperm"}, {"point_2d": [534.5, 467.0], "label": "sperm"}, {"point_2d": [545.5, 360.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [554.0, 196.5], "label": "sperm"}, {"point_2d": [424.5, 81.0], "label": "sperm"}, {"point_2d": [494.5, 36.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [371.5, 246.0], "label": "sperm"}, {"point_2d": [314.5, 194.0], "label": "sperm"}, {"point_2d": [5.0, 138.0], "label": "sperm"}, {"point_2d": [261.0, 218.0], "label": "sperm"}, {"point_2d": [495.0, 137.0], "label": "sperm"}, {"point_2d": [628.5, 396.5], "label": "sperm"}, {"point_2d": [519.5, 451.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [57.5, 113.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [320.5, 352.5], "label": "sperm"}, {"point_2d": [281.5, 17.0], "label": "sperm"}, {"point_2d": [319.0, 8.5], "label": "sperm"}, {"point_2d": [226.0, 48.0], "label": "sperm"}, {"point_2d": [334.5, 4.5], "label": "sperm"}, {"point_2d": [234.5, 5.0], "label": "sperm"}]
```


[User] <image> Find the region corresponding to sperm and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [163.0, 198.0, 180.0, 216.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [4.0, 349.0, 21.0, 367.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [133.0, 79.0, 150.0, 99.0], "label": "sperm"}, {"bbox_2d": [160.0, 51.0, 177.0, 69.0], "label": "sperm"}, {"bbox_2d": [172.0, 96.0, 189.0, 114.0], "label": "sperm"}, {"bbox_2d": [178.0, 148.0, 195.0, 166.0], "label": "sperm"}, {"bbox_2d": [122.0, 243.0, 140.0, 265.0], "label": "sperm"}, {"bbox_2d": [343.0, 441.0, 360.0, 459.0], "label": "sperm"}, {"bbox_2d": [400.0, 268.0, 417.0, 286.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [532.0, 398.0, 549.0, 416.0], "label": "sperm"}, {"bbox_2d": [526.0, 458.0, 543.0, 476.0], "label": "sperm"}, {"bbox_2d": [537.0, 351.0, 554.0, 369.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [546.0, 187.0, 562.0, 206.0], "label": "sperm"}, {"bbox_2d": [416.0, 73.0, 433.0, 89.0], "label": "sperm"}, {"bbox_2d": [486.0, 28.0, 503.0, 44.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [363.0, 238.0, 380.0, 254.0], "label": "sperm"}, {"bbox_2d": [306.0, 186.0, 323.0, 202.0], "label": "sperm"}, {"bbox_2d": [0.0, 130.0, 10.0, 146.0], "label": "sperm"}, {"bbox_2d": [252.0, 209.0, 270.0, 227.0], "label": "sperm"}, {"bbox_2d": [486.0, 129.0, 504.0, 145.0], "label": "sperm"}, {"bbox_2d": [622.0, 388.0, 635.0, 405.0], "label": "sperm"}, {"bbox_2d": [509.0, 441.0, 530.0, 461.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [46.0, 102.0, 69.0, 124.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [307.0, 342.0, 334.0, 363.0], "label": "sperm"}, {"bbox_2d": [274.0, 10.0, 289.0, 24.0], "label": "sperm"}, {"bbox_2d": [311.0, 2.0, 327.0, 15.0], "label": "sperm"}, {"bbox_2d": [217.0, 39.0, 235.0, 57.0], "label": "sperm"}, {"bbox_2d": [325.0, 0.0, 344.0, 9.0], "label": "sperm"}, {"bbox_2d": [227.0, 0.0, 242.0, 10.0], "label": "sperm"}]
```


[User] <image> count normal sperm

[Assistant]
```json
{"count": 40, "label": "normal sperm"}
```


[User] <image> Show me each sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 40, "point_2d": [[171.5, 207.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [12.5, 358.0], [86.5, 90.5], [141.5, 89.0], [168.5, 60.0], [180.5, 105.0], [186.5, 157.0], [131.0, 254.0], [351.5, 450.0], [408.5, 277.0], [312.5, 417.0], [540.5, 407.0], [534.5, 467.0], [545.5, 360.0], [530.0, 209.5], [554.0, 196.5], [424.5, 81.0], [494.5, 36.0], [454.5, 304.5], [371.5, 246.0], [314.5, 194.0], [5.0, 138.0], [261.0, 218.0], [495.0, 137.0], [628.5, 396.5], [519.5, 451.0], [376.0, 57.0], [385.0, 99.0], [57.5, 113.0], [548.0, 107.5], [320.5, 352.5], [281.5, 17.0], [319.0, 8.5], [226.0, 48.0], [334.5, 4.5], [234.5, 5.0]], "label": "normal sperm"}
```


[User] <image> Output a list of bounding boxes for every sperm and the overall count.

[Assistant]
```json
{"count": 40, "bbox_2d": [[163.0, 198.0, 180.0, 216.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [4.0, 349.0, 21.0, 367.0], [78.0, 82.0, 95.0, 99.0], [133.0, 79.0, 150.0, 99.0], [160.0, 51.0, 177.0, 69.0], [172.0, 96.0, 189.0, 114.0], [178.0, 148.0, 195.0, 166.0], [122.0, 243.0, 140.0, 265.0], [343.0, 441.0, 360.0, 459.0], [400.0, 268.0, 417.0, 286.0], [304.0, 408.0, 321.0, 426.0], [532.0, 398.0, 549.0, 416.0], [526.0, 458.0, 543.0, 476.0], [537.0, 351.0, 554.0, 369.0], [522.0, 200.0, 538.0, 219.0], [546.0, 187.0, 562.0, 206.0], [416.0, 73.0, 433.0, 89.0], [486.0, 28.0, 503.0, 44.0], [446.0, 296.0, 463.0, 313.0], [363.0, 238.0, 380.0, 254.0], [306.0, 186.0, 323.0, 202.0], [0.0, 130.0, 10.0, 146.0], [252.0, 209.0, 270.0, 227.0], [486.0, 129.0, 504.0, 145.0], [622.0, 388.0, 635.0, 405.0], [509.0, 441.0, 530.0, 461.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [46.0, 102.0, 69.0, 124.0], [536.0, 97.0, 560.0, 118.0], [307.0, 342.0, 334.0, 363.0], [274.0, 10.0, 289.0, 24.0], [311.0, 2.0, 327.0, 15.0], [217.0, 39.0, 235.0, 57.0], [325.0, 0.0, 344.0, 9.0], [227.0, 0.0, 242.0, 10.0]], "label": "normal sperm"}
```


[User] <image> Point out every sperm cluster in the image.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Enclose cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Generate list of points showing where the cluster are and output the total count.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Point to and count the cluster in the picture.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Mark each cluster with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Locate all sperms.

[Assistant]
```json
[{"point_2d": [174.5, 201.0], "label": "sperm"}, {"point_2d": [152.5, 277.0], "label": "sperm"}, {"point_2d": [155.5, 409.0], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [16.5, 350.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [139.5, 73.0], "label": "sperm"}, {"point_2d": [189.5, 50.0], "label": "sperm"}, {"point_2d": [181.5, 104.0], "label": "sperm"}, {"point_2d": [199.5, 148.0], "label": "sperm"}, {"point_2d": [244.0, 135.0], "label": "sperm"}, {"point_2d": [368.5, 425.0], "label": "sperm"}, {"point_2d": [411.5, 272.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [437.5, 376.0], "label": "sperm"}, {"point_2d": [542.5, 403.0], "label": "sperm"}, {"point_2d": [536.5, 463.0], "label": "sperm"}, {"point_2d": [546.5, 359.0], "label": "sperm"}, {"point_2d": [630.5, 397.5], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [555.0, 196.5], "label": "sperm"}, {"point_2d": [404.5, 68.5], "label": "sperm"}, {"point_2d": [428.5, 68.0], "label": "sperm"}, {"point_2d": [493.5, 32.0], "label": "sperm"}, {"point_2d": [454.5, 305.0], "label": "sperm"}, {"point_2d": [377.5, 234.0], "label": "sperm"}, {"point_2d": [318.5, 186.0], "label": "sperm"}, {"point_2d": [6.0, 280.5], "label": "sperm"}, {"point_2d": [9.5, 113.0], "label": "sperm"}, {"point_2d": [114.0, 123.0], "label": "sperm"}, {"point_2d": [488.5, 328.0], "label": "sperm"}, {"point_2d": [634.0, 371.5], "label": "sperm"}, {"point_2d": [410.0, 218.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [167.5, 287.0], "label": "sperm"}, {"point_2d": [262.5, 253.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [326.5, 346.5], "label": "sperm"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [166.0, 192.0, 183.0, 210.0], "label": "sperm"}, {"bbox_2d": [144.0, 268.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [147.0, 400.0, 164.0, 418.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [8.0, 341.0, 25.0, 359.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [131.0, 64.0, 148.0, 82.0], "label": "sperm"}, {"bbox_2d": [181.0, 41.0, 198.0, 59.0], "label": "sperm"}, {"bbox_2d": [173.0, 95.0, 190.0, 113.0], "label": "sperm"}, {"bbox_2d": [191.0, 139.0, 208.0, 157.0], "label": "sperm"}, {"bbox_2d": [235.0, 125.0, 253.0, 145.0], "label": "sperm"}, {"bbox_2d": [360.0, 416.0, 377.0, 434.0], "label": "sperm"}, {"bbox_2d": [403.0, 263.0, 420.0, 281.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [430.0, 367.0, 445.0, 385.0], "label": "sperm"}, {"bbox_2d": [534.0, 394.0, 551.0, 412.0], "label": "sperm"}, {"bbox_2d": [528.0, 454.0, 545.0, 472.0], "label": "sperm"}, {"bbox_2d": [538.0, 350.0, 555.0, 368.0], "label": "sperm"}, {"bbox_2d": [622.0, 387.0, 639.0, 408.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [547.0, 187.0, 563.0, 206.0], "label": "sperm"}, {"bbox_2d": [397.0, 60.0, 412.0, 77.0], "label": "sperm"}, {"bbox_2d": [420.0, 60.0, 437.0, 76.0], "label": "sperm"}, {"bbox_2d": [485.0, 24.0, 502.0, 40.0], "label": "sperm"}, {"bbox_2d": [446.0, 297.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [369.0, 226.0, 386.0, 242.0], "label": "sperm"}, {"bbox_2d": [310.0, 178.0, 327.0, 194.0], "label": "sperm"}, {"bbox_2d": [0.0, 271.0, 12.0, 290.0], "label": "sperm"}, {"bbox_2d": [1.0, 105.0, 18.0, 121.0], "label": "sperm"}, {"bbox_2d": [105.0, 114.0, 123.0, 132.0], "label": "sperm"}, {"bbox_2d": [480.0, 320.0, 497.0, 336.0], "label": "sperm"}, {"bbox_2d": [628.0, 363.0, 640.0, 380.0], "label": "sperm"}, {"bbox_2d": [402.0, 210.0, 418.0, 226.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [156.0, 276.0, 179.0, 298.0], "label": "sperm"}, {"bbox_2d": [252.0, 244.0, 273.0, 262.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [313.0, 336.0, 340.0, 357.0], "label": "sperm"}]
```


[User]
<image> Point to all the normal sperm visible and output the total count.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
{"count": 40, "label": "normal sperm"}
```


[User] <image> Count the normal sperm in the image, then point to them.

[Assistant]
```json
{"count": 40, "point_2d": [[174.5, 201.0], [152.5, 277.0], [155.5, 409.0], [124.5, 406.0], [53.0, 387.0], [16.5, 350.0], [86.5, 90.5], [139.5, 73.0], [189.5, 50.0], [181.5, 104.0], [199.5, 148.0], [244.0, 135.0], [368.5, 425.0], [411.5, 272.0], [312.5, 417.0], [437.5, 376.0], [542.5, 403.0], [536.5, 463.0], [546.5, 359.0], [630.5, 397.5], [530.0, 209.5], [555.0, 196.5], [404.5, 68.5], [428.5, 68.0], [493.5, 32.0], [454.5, 305.0], [377.5, 234.0], [318.5, 186.0], [6.0, 280.5], [9.5, 113.0], [114.0, 123.0], [488.5, 328.0], [634.0, 371.5], [410.0, 218.0], [376.0, 57.0], [385.0, 99.0], [167.5, 287.0], [262.5, 253.0], [548.0, 107.5], [326.5, 346.5]], "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 40, "bbox_2d": [[166.0, 192.0, 183.0, 210.0], [144.0, 268.0, 161.0, 286.0], [147.0, 400.0, 164.0, 418.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [8.0, 341.0, 25.0, 359.0], [78.0, 82.0, 95.0, 99.0], [131.0, 64.0, 148.0, 82.0], [181.0, 41.0, 198.0, 59.0], [173.0, 95.0, 190.0, 113.0], [191.0, 139.0, 208.0, 157.0], [235.0, 125.0, 253.0, 145.0], [360.0, 416.0, 377.0, 434.0], [403.0, 263.0, 420.0, 281.0], [304.0, 408.0, 321.0, 426.0], [430.0, 367.0, 445.0, 385.0], [534.0, 394.0, 551.0, 412.0], [528.0, 454.0, 545.0, 472.0], [538.0, 350.0, 555.0, 368.0], [622.0, 387.0, 639.0, 408.0], [522.0, 200.0, 538.0, 219.0], [547.0, 187.0, 563.0, 206.0], [397.0, 60.0, 412.0, 77.0], [420.0, 60.0, 437.0, 76.0], [485.0, 24.0, 502.0, 40.0], [446.0, 297.0, 463.0, 313.0], [369.0, 226.0, 386.0, 242.0], [310.0, 178.0, 327.0, 194.0], [0.0, 271.0, 12.0, 290.0], [1.0, 105.0, 18.0, 121.0], [105.0, 114.0, 123.0, 132.0], [480.0, 320.0, 497.0, 336.0], [628.0, 363.0, 640.0, 380.0], [402.0, 210.0, 418.0, 226.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [156.0, 276.0, 179.0, 298.0], [252.0, 244.0, 273.0, 262.0], [536.0, 97.0, 560.0, 118.0], [313.0, 336.0, 340.0, 357.0]], "label": "normal sperm"}
```


[User] <image> Locate all clusters.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Locate the sperm cluster and mark it with a bounding box in the image.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> If you see any cluster in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Mark all visible cluster in the image with a point and then provide the count.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Detect all cluster in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> If there is a sperm present, indicate its position.

[Assistant]
```json
[{"point_2d": [174.5, 201.0], "label": "sperm"}, {"point_2d": [152.5, 277.0], "label": "sperm"}, {"point_2d": [155.5, 410.0], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [16.5, 350.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [139.5, 78.0], "label": "sperm"}, {"point_2d": [188.5, 50.0], "label": "sperm"}, {"point_2d": [181.5, 104.0], "label": "sperm"}, {"point_2d": [199.5, 148.0], "label": "sperm"}, {"point_2d": [212.5, 141.0], "label": "sperm"}, {"point_2d": [367.5, 425.0], "label": "sperm"}, {"point_2d": [411.5, 272.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [463.5, 388.0], "label": "sperm"}, {"point_2d": [542.5, 404.0], "label": "sperm"}, {"point_2d": [536.5, 464.0], "label": "sperm"}, {"point_2d": [546.5, 359.0], "label": "sperm"}, {"point_2d": [634.0, 406.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [555.0, 196.5], "label": "sperm"}, {"point_2d": [405.5, 54.5], "label": "sperm"}, {"point_2d": [428.5, 68.0], "label": "sperm"}, {"point_2d": [493.5, 32.0], "label": "sperm"}, {"point_2d": [454.5, 305.0], "label": "sperm"}, {"point_2d": [377.5, 235.0], "label": "sperm"}, {"point_2d": [318.5, 186.0], "label": "sperm"}, {"point_2d": [4.5, 278.5], "label": "sperm"}, {"point_2d": [8.5, 114.0], "label": "sperm"}, {"point_2d": [125.0, 131.0], "label": "sperm"}, {"point_2d": [496.5, 320.0], "label": "sperm"}, {"point_2d": [634.5, 371.5], "label": "sperm"}, {"point_2d": [405.0, 236.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [161.5, 266.0], "label": "sperm"}, {"point_2d": [228.5, 248.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [325.5, 346.5], "label": "sperm"}]
```


[User] <image> Specify the bounding box for the normal sperm in the image.

[Assistant]
```json
[{"bbox_2d": [166.0, 192.0, 183.0, 210.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 268.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [147.0, 401.0, 164.0, 419.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [8.0, 341.0, 25.0, 359.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [131.0, 69.0, 148.0, 87.0], "label": "normal sperm"}, {"bbox_2d": [180.0, 41.0, 197.0, 59.0], "label": "normal sperm"}, {"bbox_2d": [173.0, 95.0, 190.0, 113.0], "label": "normal sperm"}, {"bbox_2d": [191.0, 139.0, 208.0, 157.0], "label": "normal sperm"}, {"bbox_2d": [204.0, 131.0, 221.0, 151.0], "label": "normal sperm"}, {"bbox_2d": [359.0, 416.0, 376.0, 434.0], "label": "normal sperm"}, {"bbox_2d": [403.0, 263.0, 420.0, 281.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [456.0, 379.0, 471.0, 397.0], "label": "normal sperm"}, {"bbox_2d": [534.0, 395.0, 551.0, 413.0], "label": "normal sperm"}, {"bbox_2d": [528.0, 455.0, 545.0, 473.0], "label": "normal sperm"}, {"bbox_2d": [538.0, 350.0, 555.0, 368.0], "label": "normal sperm"}, {"bbox_2d": [628.0, 396.0, 640.0, 416.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [547.0, 187.0, 563.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [398.0, 46.0, 413.0, 63.0], "label": "normal sperm"}, {"bbox_2d": [420.0, 60.0, 437.0, 76.0], "label": "normal sperm"}, {"bbox_2d": [485.0, 24.0, 502.0, 40.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 297.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [369.0, 227.0, 386.0, 243.0], "label": "normal sperm"}, {"bbox_2d": [310.0, 178.0, 327.0, 194.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 269.0, 9.0, 288.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 106.0, 17.0, 122.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 122.0, 134.0, 140.0], "label": "normal sperm"}, {"bbox_2d": [488.0, 312.0, 505.0, 328.0], "label": "normal sperm"}, {"bbox_2d": [629.0, 363.0, 640.0, 380.0], "label": "normal sperm"}, {"bbox_2d": [397.0, 228.0, 413.0, 244.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [150.0, 255.0, 173.0, 277.0], "label": "normal sperm"}, {"bbox_2d": [218.0, 239.0, 239.0, 257.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [312.0, 336.0, 339.0, 357.0], "label": "normal sperm"}]
```


[User] <image> Generate list of points showing where the normal sperm are and output the total count.

[Assistant]
```json
{"count": 40, "label": "normal sperm"}
```


[User] <image> Locate the normal sperm and count them, then point to them.

[Assistant]
```json
{"count": 40, "point_2d": [[174.5, 201.0], [152.5, 277.0], [155.5, 410.0], [124.5, 406.0], [53.0, 387.0], [16.5, 350.0], [86.5, 90.5], [139.5, 78.0], [188.5, 50.0], [181.5, 104.0], [199.5, 148.0], [212.5, 141.0], [367.5, 425.0], [411.5, 272.0], [312.5, 417.0], [463.5, 388.0], [542.5, 404.0], [536.5, 464.0], [546.5, 359.0], [634.0, 406.0], [530.0, 209.5], [555.0, 196.5], [405.5, 54.5], [428.5, 68.0], [493.5, 32.0], [454.5, 305.0], [377.5, 235.0], [318.5, 186.0], [4.5, 278.5], [8.5, 114.0], [125.0, 131.0], [496.5, 320.0], [634.5, 371.5], [405.0, 236.0], [376.0, 57.0], [385.0, 99.0], [161.5, 266.0], [228.5, 248.0], [548.0, 107.5], [325.5, 346.5]], "label": "normal sperm"}
```


[User] <image> Find all normal sperm in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 40, "bbox_2d": [[166.0, 192.0, 183.0, 210.0], [144.0, 268.0, 161.0, 286.0], [147.0, 401.0, 164.0, 419.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [8.0, 341.0, 25.0, 359.0], [78.0, 82.0, 95.0, 99.0], [131.0, 69.0, 148.0, 87.0], [180.0, 41.0, 197.0, 59.0], [173.0, 95.0, 190.0, 113.0], [191.0, 139.0, 208.0, 157.0], [204.0, 131.0, 221.0, 151.0], [359.0, 416.0, 376.0, 434.0], [403.0, 263.0, 420.0, 281.0], [304.0, 408.0, 321.0, 426.0], [456.0, 379.0, 471.0, 397.0], [534.0, 395.0, 551.0, 413.0], [528.0, 455.0, 545.0, 473.0], [538.0, 350.0, 555.0, 368.0], [628.0, 396.0, 640.0, 416.0], [522.0, 200.0, 538.0, 219.0], [547.0, 187.0, 563.0, 206.0], [398.0, 46.0, 413.0, 63.0], [420.0, 60.0, 437.0, 76.0], [485.0, 24.0, 502.0, 40.0], [446.0, 297.0, 463.0, 313.0], [369.0, 227.0, 386.0, 243.0], [310.0, 178.0, 327.0, 194.0], [0.0, 269.0, 9.0, 288.0], [0.0, 106.0, 17.0, 122.0], [116.0, 122.0, 134.0, 140.0], [488.0, 312.0, 505.0, 328.0], [629.0, 363.0, 640.0, 380.0], [397.0, 228.0, 413.0, 244.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [150.0, 255.0, 173.0, 277.0], [218.0, 239.0, 239.0, 257.0], [536.0, 97.0, 560.0, 118.0], [312.0, 336.0, 339.0, 357.0]], "label": "normal sperm"}
```


[User] <image> Can you point out all sperm clusters in this image?

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Locate and mark cluster with a bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> In all the picture, how many cluster are there?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Point out every sperm cluster you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Output a list of bounding boxes for every sperm cluster and the overall count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Point to all occurrences of "normal sperms"

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [123.5, 130.0], "label": "normal sperm"}, {"point_2d": [131.5, 95.0], "label": "normal sperm"}, {"point_2d": [165.5, 131.0], "label": "normal sperm"}, {"point_2d": [137.5, 194.0], "label": "normal sperm"}, {"point_2d": [345.0, 470.5], "label": "normal sperm"}, {"point_2d": [401.5, 290.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [538.5, 375.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [401.5, 114.0], "label": "normal sperm"}, {"point_2d": [471.5, 75.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [312.5, 295.0], "label": "normal sperm"}, {"point_2d": [293.5, 227.0], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [310.5, 364.5], "label": "normal sperm"}, {"point_2d": [115.0, 341.5], "label": "normal sperm"}, {"point_2d": [308.0, 23.5], "label": "normal sperm"}, {"point_2d": [325.5, 13.5], "label": "normal sperm"}, {"point_2d": [228.5, 30.0], "label": "normal sperm"}, {"point_2d": [514.0, 202.5], "label": "normal sperm"}, {"point_2d": [620.0, 19.5], "label": "normal sperm"}]
```


[User] <image> Mark the object sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [115.0, 120.0, 132.0, 140.0], "label": "sperm"}, {"bbox_2d": [123.0, 86.0, 140.0, 104.0], "label": "sperm"}, {"bbox_2d": [157.0, 122.0, 174.0, 140.0], "label": "sperm"}, {"bbox_2d": [129.0, 185.0, 146.0, 203.0], "label": "sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [530.0, 366.0, 547.0, 384.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [393.0, 106.0, 410.0, 122.0], "label": "sperm"}, {"bbox_2d": [463.0, 67.0, 480.0, 83.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [303.0, 287.0, 322.0, 303.0], "label": "sperm"}, {"bbox_2d": [285.0, 219.0, 302.0, 235.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [297.0, 354.0, 324.0, 375.0], "label": "sperm"}, {"bbox_2d": [107.0, 332.0, 123.0, 351.0], "label": "sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "sperm"}, {"bbox_2d": [316.0, 6.0, 335.0, 21.0], "label": "sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "sperm"}, {"bbox_2d": [503.0, 193.0, 525.0, 212.0], "label": "sperm"}, {"bbox_2d": [612.0, 10.0, 628.0, 29.0], "label": "sperm"}]
```


[User] <image> How many sperm do you see?

[Assistant]
```json
{"count": 33, "label": "sperm"}
```


[User] <image> Find each normal sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 33, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [123.5, 130.0], [131.5, 95.0], [165.5, 131.0], [137.5, 194.0], [345.0, 470.5], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 375.0], [530.0, 209.5], [553.0, 196.5], [401.5, 114.0], [471.5, 75.0], [454.5, 304.5], [312.5, 295.0], [293.5, 227.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 364.5], [115.0, 341.5], [308.0, 23.5], [325.5, 13.5], [228.5, 30.0], [514.0, 202.5], [620.0, 19.5]], "label": "sperm"}
```


[User] <image> Return bounding boxes for each normal sperm in the image and the total count.

[Assistant]
```json
{"count": 33, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [115.0, 120.0, 132.0, 140.0], [123.0, 86.0, 140.0, 104.0], [157.0, 122.0, 174.0, 140.0], [129.0, 185.0, 146.0, 203.0], [336.0, 461.0, 354.0, 480.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 366.0, 547.0, 384.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [393.0, 106.0, 410.0, 122.0], [463.0, 67.0, 480.0, 83.0], [446.0, 296.0, 463.0, 313.0], [303.0, 287.0, 322.0, 303.0], [285.0, 219.0, 302.0, 235.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 354.0, 324.0, 375.0], [107.0, 332.0, 123.0, 351.0], [300.0, 17.0, 316.0, 30.0], [316.0, 6.0, 335.0, 21.0], [221.0, 23.0, 236.0, 37.0], [503.0, 193.0, 525.0, 212.0], [612.0, 10.0, 628.0, 29.0]], "label": "sperm"}
```


[User] <image> Show me where the clusters are

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Outline the area containing cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Count all the cluster

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Find all the cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Find all cluster in the image, draw bounding boxes around them, and then count them.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User]
<image> Object: sperm
Instruction: Point to the object.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [130.5, 120.0], "label": "sperm"}, {"point_2d": [132.5, 94.0], "label": "sperm"}, {"point_2d": [166.5, 129.0], "label": "sperm"}, {"point_2d": [137.5, 193.0], "label": "sperm"}, {"point_2d": [345.0, 470.5], "label": "sperm"}, {"point_2d": [401.5, 290.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [538.5, 375.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [401.5, 114.0], "label": "sperm"}, {"point_2d": [471.5, 74.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [314.5, 294.0], "label": "sperm"}, {"point_2d": [293.5, 226.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [310.5, 364.5], "label": "sperm"}, {"point_2d": [439.5, 466.5], "label": "sperm"}, {"point_2d": [122.0, 340.5], "label": "sperm"}, {"point_2d": [308.0, 23.5], "label": "sperm"}, {"point_2d": [325.5, 13.5], "label": "sperm"}, {"point_2d": [228.5, 30.0], "label": "sperm"}, {"point_2d": [501.0, 192.5], "label": "sperm"}, {"point_2d": [621.0, 19.0], "label": "sperm"}]
```


[User] <image> Detect the sperm and enclose it in a bounding box with coordinates.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [122.0, 110.0, 139.0, 130.0], "label": "sperm"}, {"bbox_2d": [124.0, 85.0, 141.0, 103.0], "label": "sperm"}, {"bbox_2d": [158.0, 120.0, 175.0, 138.0], "label": "sperm"}, {"bbox_2d": [129.0, 184.0, 146.0, 202.0], "label": "sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [530.0, 366.0, 547.0, 384.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [393.0, 106.0, 410.0, 122.0], "label": "sperm"}, {"bbox_2d": [463.0, 66.0, 480.0, 82.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [305.0, 286.0, 324.0, 302.0], "label": "sperm"}, {"bbox_2d": [285.0, 218.0, 302.0, 234.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [297.0, 354.0, 324.0, 375.0], "label": "sperm"}, {"bbox_2d": [430.0, 457.0, 449.0, 476.0], "label": "sperm"}, {"bbox_2d": [114.0, 331.0, 130.0, 350.0], "label": "sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "sperm"}, {"bbox_2d": [316.0, 6.0, 335.0, 21.0], "label": "sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "sperm"}, {"bbox_2d": [490.0, 183.0, 512.0, 202.0], "label": "sperm"}, {"bbox_2d": [613.0, 10.0, 629.0, 28.0], "label": "sperm"}]
```


[User] <image> Tell me how many normal sperm there are

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a point, then output how many there are.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [130.5, 120.0], [132.5, 94.0], [166.5, 129.0], [137.5, 193.0], [345.0, 470.5], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 375.0], [530.0, 209.5], [553.0, 196.5], [401.5, 114.0], [471.5, 74.0], [454.5, 304.5], [314.5, 294.0], [293.5, 226.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 364.5], [439.5, 466.5], [122.0, 340.5], [308.0, 23.5], [325.5, 13.5], [228.5, 30.0], [501.0, 192.5], [621.0, 19.0]], "label": "normal sperm"}
```


[User] <image> Count all normal sperm in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [122.0, 110.0, 139.0, 130.0], [124.0, 85.0, 141.0, 103.0], [158.0, 120.0, 175.0, 138.0], [129.0, 184.0, 146.0, 202.0], [336.0, 461.0, 354.0, 480.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 366.0, 547.0, 384.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [393.0, 106.0, 410.0, 122.0], [463.0, 66.0, 480.0, 82.0], [446.0, 296.0, 463.0, 313.0], [305.0, 286.0, 324.0, 302.0], [285.0, 218.0, 302.0, 234.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 354.0, 324.0, 375.0], [430.0, 457.0, 449.0, 476.0], [114.0, 331.0, 130.0, 350.0], [300.0, 17.0, 316.0, 30.0], [316.0, 6.0, 335.0, 21.0], [221.0, 23.0, 236.0, 37.0], [490.0, 183.0, 512.0, 202.0], [613.0, 10.0, 629.0, 28.0]], "label": "normal sperm"}
```


[User] <image> Can you show me where the clusters are?

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Find the sperm cluster in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> Can you see any sperm cluster in the image? How many are there?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Point to all sperm cluster in the image and then count them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Output the total count of sperm cluster in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Find the normal sperm.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [135.5, 117.0], "label": "normal sperm"}, {"point_2d": [132.5, 93.0], "label": "normal sperm"}, {"point_2d": [166.5, 129.0], "label": "normal sperm"}, {"point_2d": [138.5, 192.0], "label": "normal sperm"}, {"point_2d": [345.0, 470.5], "label": "normal sperm"}, {"point_2d": [401.5, 290.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [538.5, 374.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [401.5, 114.0], "label": "normal sperm"}, {"point_2d": [471.5, 73.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [314.5, 293.0], "label": "normal sperm"}, {"point_2d": [293.5, 226.0], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [310.5, 363.5], "label": "normal sperm"}, {"point_2d": [442.5, 463.5], "label": "normal sperm"}, {"point_2d": [124.0, 340.5], "label": "normal sperm"}, {"point_2d": [308.0, 23.5], "label": "normal sperm"}, {"point_2d": [325.5, 13.5], "label": "normal sperm"}, {"point_2d": [228.5, 30.0], "label": "normal sperm"}, {"point_2d": [496.0, 177.5], "label": "normal sperm"}, {"point_2d": [621.0, 18.0], "label": "normal sperm"}]
```


[User] <image> Return the rectangular bounding box that covers sperm in the image.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [127.0, 107.0, 144.0, 127.0], "label": "sperm"}, {"bbox_2d": [124.0, 84.0, 141.0, 102.0], "label": "sperm"}, {"bbox_2d": [158.0, 120.0, 175.0, 138.0], "label": "sperm"}, {"bbox_2d": [130.0, 183.0, 147.0, 201.0], "label": "sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [530.0, 365.0, 547.0, 383.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [393.0, 106.0, 410.0, 122.0], "label": "sperm"}, {"bbox_2d": [463.0, 65.0, 480.0, 81.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [305.0, 285.0, 324.0, 301.0], "label": "sperm"}, {"bbox_2d": [285.0, 218.0, 302.0, 234.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [297.0, 353.0, 324.0, 374.0], "label": "sperm"}, {"bbox_2d": [433.0, 454.0, 452.0, 473.0], "label": "sperm"}, {"bbox_2d": [116.0, 331.0, 132.0, 350.0], "label": "sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "sperm"}, {"bbox_2d": [316.0, 6.0, 335.0, 21.0], "label": "sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "sperm"}, {"bbox_2d": [485.0, 168.0, 507.0, 187.0], "label": "sperm"}, {"bbox_2d": [613.0, 9.0, 629.0, 27.0], "label": "sperm"}]
```


[User] <image> If there are any sperm present, indicate their positions and output the total count.

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Count the normal sperm in the image, then point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [135.5, 117.0], [132.5, 93.0], [166.5, 129.0], [138.5, 192.0], [345.0, 470.5], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 374.0], [530.0, 209.5], [553.0, 196.5], [401.5, 114.0], [471.5, 73.0], [454.5, 304.5], [314.5, 293.0], [293.5, 226.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 363.5], [442.5, 463.5], [124.0, 340.5], [308.0, 23.5], [325.5, 13.5], [228.5, 30.0], [496.0, 177.5], [621.0, 18.0]], "label": "sperm"}
```


[User] <image> Find all normal sperm in the image, draw bounding boxes around them, and then count them.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [127.0, 107.0, 144.0, 127.0], [124.0, 84.0, 141.0, 102.0], [158.0, 120.0, 175.0, 138.0], [130.0, 183.0, 147.0, 201.0], [336.0, 461.0, 354.0, 480.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 365.0, 547.0, 383.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [393.0, 106.0, 410.0, 122.0], [463.0, 65.0, 480.0, 81.0], [446.0, 296.0, 463.0, 313.0], [305.0, 285.0, 324.0, 301.0], [285.0, 218.0, 302.0, 234.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 353.0, 324.0, 374.0], [433.0, 454.0, 452.0, 473.0], [116.0, 331.0, 132.0, 350.0], [300.0, 17.0, 316.0, 30.0], [316.0, 6.0, 335.0, 21.0], [221.0, 23.0, 236.0, 37.0], [485.0, 168.0, 507.0, 187.0], [613.0, 9.0, 629.0, 27.0]], "label": "sperm"}
```


[User] <image> Point to an cluster

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Return the bounding box of the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> How many cluster?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Indicate each sperm cluster in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Return both the count and the bounding boxes of all sperm cluster in the image.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Locate the normal sperm.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [124.5, 125.0], "label": "normal sperm"}, {"point_2d": [131.5, 95.0], "label": "normal sperm"}, {"point_2d": [165.5, 131.0], "label": "normal sperm"}, {"point_2d": [137.5, 194.0], "label": "normal sperm"}, {"point_2d": [345.0, 470.5], "label": "normal sperm"}, {"point_2d": [401.5, 290.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [538.5, 375.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [401.5, 114.0], "label": "normal sperm"}, {"point_2d": [471.5, 75.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [312.5, 294.0], "label": "normal sperm"}, {"point_2d": [293.5, 227.0], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [310.5, 364.5], "label": "normal sperm"}, {"point_2d": [429.5, 473.5], "label": "normal sperm"}, {"point_2d": [116.0, 341.5], "label": "normal sperm"}, {"point_2d": [308.0, 23.5], "label": "normal sperm"}, {"point_2d": [325.5, 13.5], "label": "normal sperm"}, {"point_2d": [228.5, 30.0], "label": "normal sperm"}, {"point_2d": [512.5, 196.5], "label": "normal sperm"}, {"point_2d": [620.0, 19.5], "label": "normal sperm"}]
```


[User] <image> Return the rectangular bounding box that covers sperm in the image.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [116.0, 115.0, 133.0, 135.0], "label": "sperm"}, {"bbox_2d": [123.0, 86.0, 140.0, 104.0], "label": "sperm"}, {"bbox_2d": [157.0, 122.0, 174.0, 140.0], "label": "sperm"}, {"bbox_2d": [129.0, 185.0, 146.0, 203.0], "label": "sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [530.0, 366.0, 547.0, 384.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [393.0, 106.0, 410.0, 122.0], "label": "sperm"}, {"bbox_2d": [463.0, 67.0, 480.0, 83.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [303.0, 286.0, 322.0, 302.0], "label": "sperm"}, {"bbox_2d": [285.0, 219.0, 302.0, 235.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [297.0, 354.0, 324.0, 375.0], "label": "sperm"}, {"bbox_2d": [421.0, 469.0, 438.0, 478.0], "label": "sperm"}, {"bbox_2d": [108.0, 332.0, 124.0, 351.0], "label": "sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "sperm"}, {"bbox_2d": [316.0, 6.0, 335.0, 21.0], "label": "sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "sperm"}, {"bbox_2d": [501.0, 187.0, 524.0, 206.0], "label": "sperm"}, {"bbox_2d": [612.0, 10.0, 628.0, 29.0], "label": "sperm"}]
```


[User] <image> Point to and count the normal sperm in the picture.

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Point to all normal sperm in the image and then count them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [124.5, 125.0], [131.5, 95.0], [165.5, 131.0], [137.5, 194.0], [345.0, 470.5], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 375.0], [530.0, 209.5], [553.0, 196.5], [401.5, 114.0], [471.5, 75.0], [454.5, 304.5], [312.5, 294.0], [293.5, 227.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 364.5], [429.5, 473.5], [116.0, 341.5], [308.0, 23.5], [325.5, 13.5], [228.5, 30.0], [512.5, 196.5], [620.0, 19.5]], "label": "normal sperm"}
```


[User] <image> Mark each normal sperm with a bounding box and return the number of instances.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [116.0, 115.0, 133.0, 135.0], [123.0, 86.0, 140.0, 104.0], [157.0, 122.0, 174.0, 140.0], [129.0, 185.0, 146.0, 203.0], [336.0, 461.0, 354.0, 480.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 366.0, 547.0, 384.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [393.0, 106.0, 410.0, 122.0], [463.0, 67.0, 480.0, 83.0], [446.0, 296.0, 463.0, 313.0], [303.0, 286.0, 322.0, 302.0], [285.0, 219.0, 302.0, 235.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 354.0, 324.0, 375.0], [421.0, 469.0, 438.0, 478.0], [108.0, 332.0, 124.0, 351.0], [300.0, 17.0, 316.0, 30.0], [316.0, 6.0, 335.0, 21.0], [221.0, 23.0, 236.0, 37.0], [501.0, 187.0, 524.0, 206.0], [612.0, 10.0, 628.0, 29.0]], "label": "normal sperm"}
```


[User] <image> Find sperm cluster.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Return the bounding box of the sperm cluster.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User]
<image> Object: cluster
Instruction: How many are there?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Locate the sperm cluster and count them, then point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Detect all sperm cluster in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Find any sperms in the picture

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [140.5, 107.0], "label": "sperm"}, {"point_2d": [133.5, 91.0], "label": "sperm"}, {"point_2d": [168.5, 126.0], "label": "sperm"}, {"point_2d": [139.5, 191.0], "label": "sperm"}, {"point_2d": [345.0, 470.5], "label": "sperm"}, {"point_2d": [402.5, 291.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [538.5, 372.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [401.5, 114.0], "label": "sperm"}, {"point_2d": [471.5, 71.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [317.5, 292.0], "label": "sperm"}, {"point_2d": [293.5, 224.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [310.5, 363.5], "label": "sperm"}, {"point_2d": [455.5, 453.5], "label": "sperm"}, {"point_2d": [138.0, 358.5], "label": "sperm"}, {"point_2d": [308.0, 23.5], "label": "sperm"}, {"point_2d": [325.5, 13.5], "label": "sperm"}, {"point_2d": [228.5, 30.0], "label": "sperm"}, {"point_2d": [512.0, 149.5], "label": "sperm"}, {"point_2d": [622.0, 17.0], "label": "sperm"}]
```


[User] <image> Detect the sperm and enclose it in a bounding box with coordinates.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [132.0, 97.0, 149.0, 117.0], "label": "sperm"}, {"bbox_2d": [125.0, 82.0, 142.0, 100.0], "label": "sperm"}, {"bbox_2d": [160.0, 117.0, 177.0, 135.0], "label": "sperm"}, {"bbox_2d": [131.0, 182.0, 148.0, 200.0], "label": "sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [530.0, 363.0, 547.0, 381.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [393.0, 106.0, 410.0, 122.0], "label": "sperm"}, {"bbox_2d": [463.0, 63.0, 480.0, 79.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [308.0, 284.0, 327.0, 300.0], "label": "sperm"}, {"bbox_2d": [285.0, 216.0, 302.0, 232.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [297.0, 353.0, 324.0, 374.0], "label": "sperm"}, {"bbox_2d": [446.0, 444.0, 465.0, 463.0], "label": "sperm"}, {"bbox_2d": [130.0, 349.0, 146.0, 368.0], "label": "sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "sperm"}, {"bbox_2d": [316.0, 6.0, 335.0, 21.0], "label": "sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "sperm"}, {"bbox_2d": [501.0, 140.0, 523.0, 159.0], "label": "sperm"}, {"bbox_2d": [614.0, 8.0, 630.0, 26.0], "label": "sperm"}]
```


[User] <image> How many normal sperm are visible in the image?

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Point out every normal sperm you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [140.5, 107.0], [133.5, 91.0], [168.5, 126.0], [139.5, 191.0], [345.0, 470.5], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 372.0], [530.0, 209.5], [553.0, 196.5], [401.5, 114.0], [471.5, 71.0], [454.5, 304.5], [317.5, 292.0], [293.5, 224.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 363.5], [455.5, 453.5], [138.0, 358.5], [308.0, 23.5], [325.5, 13.5], [228.5, 30.0], [512.0, 149.5], [622.0, 17.0]], "label": "normal sperm"}
```


[User] <image> Find all normal sperm in the image, draw bounding boxes around them, and then count them.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [132.0, 97.0, 149.0, 117.0], [125.0, 82.0, 142.0, 100.0], [160.0, 117.0, 177.0, 135.0], [131.0, 182.0, 148.0, 200.0], [336.0, 461.0, 354.0, 480.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 363.0, 547.0, 381.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [393.0, 106.0, 410.0, 122.0], [463.0, 63.0, 480.0, 79.0], [446.0, 296.0, 463.0, 313.0], [308.0, 284.0, 327.0, 300.0], [285.0, 216.0, 302.0, 232.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 353.0, 324.0, 374.0], [446.0, 444.0, 465.0, 463.0], [130.0, 349.0, 146.0, 368.0], [300.0, 17.0, 316.0, 30.0], [316.0, 6.0, 335.0, 21.0], [221.0, 23.0, 236.0, 37.0], [501.0, 140.0, 523.0, 159.0], [614.0, 8.0, 630.0, 26.0]], "label": "normal sperm"}
```


[User] <image> Point out every sperm cluster in the image.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Identify cluster and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Point to all occurrences of "cluster" and output the total count.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Identify all occurrences of sperm cluster by marking them, and then provide the count.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Outline all instances of sperm cluster with bounding boxes, then return the count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Point out every sperm in the image.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [131.5, 121.0], "label": "sperm"}, {"point_2d": [131.5, 94.0], "label": "sperm"}, {"point_2d": [166.5, 130.0], "label": "sperm"}, {"point_2d": [137.5, 193.0], "label": "sperm"}, {"point_2d": [345.0, 470.5], "label": "sperm"}, {"point_2d": [401.5, 290.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [538.5, 375.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [401.5, 114.0], "label": "sperm"}, {"point_2d": [471.5, 74.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [313.5, 294.0], "label": "sperm"}, {"point_2d": [293.5, 227.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [310.5, 364.5], "label": "sperm"}, {"point_2d": [434.5, 467.5], "label": "sperm"}, {"point_2d": [120.0, 340.5], "label": "sperm"}, {"point_2d": [308.0, 23.5], "label": "sperm"}, {"point_2d": [325.5, 13.5], "label": "sperm"}, {"point_2d": [228.5, 30.0], "label": "sperm"}, {"point_2d": [511.0, 191.5], "label": "sperm"}, {"point_2d": [620.0, 19.0], "label": "sperm"}]
```


[User] <image> Locate the normal sperm and mark it with a bounding box in the image.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [123.0, 111.0, 140.0, 131.0], "label": "normal sperm"}, {"bbox_2d": [123.0, 85.0, 140.0, 103.0], "label": "normal sperm"}, {"bbox_2d": [158.0, 121.0, 175.0, 139.0], "label": "normal sperm"}, {"bbox_2d": [129.0, 184.0, 146.0, 202.0], "label": "normal sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [530.0, 366.0, 547.0, 384.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [393.0, 106.0, 410.0, 122.0], "label": "normal sperm"}, {"bbox_2d": [463.0, 66.0, 480.0, 82.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 286.0, 323.0, 302.0], "label": "normal sperm"}, {"bbox_2d": [285.0, 219.0, 302.0, 235.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [297.0, 354.0, 324.0, 375.0], "label": "normal sperm"}, {"bbox_2d": [425.0, 458.0, 444.0, 477.0], "label": "normal sperm"}, {"bbox_2d": [112.0, 331.0, 128.0, 350.0], "label": "normal sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "normal sperm"}, {"bbox_2d": [316.0, 6.0, 335.0, 21.0], "label": "normal sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "normal sperm"}, {"bbox_2d": [500.0, 182.0, 522.0, 201.0], "label": "normal sperm"}, {"bbox_2d": [612.0, 10.0, 628.0, 28.0], "label": "normal sperm"}]
```


[User] <image> Can you count the number of normal sperm in the image?

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Show me each normal sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [131.5, 121.0], [131.5, 94.0], [166.5, 130.0], [137.5, 193.0], [345.0, 470.5], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 375.0], [530.0, 209.5], [553.0, 196.5], [401.5, 114.0], [471.5, 74.0], [454.5, 304.5], [313.5, 294.0], [293.5, 227.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 364.5], [434.5, 467.5], [120.0, 340.5], [308.0, 23.5], [325.5, 13.5], [228.5, 30.0], [511.0, 191.5], [620.0, 19.0]], "label": "normal sperm"}
```


[User] <image> Identify all normal sperm in the image, count them, and provide bounding box coordinates for each.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [123.0, 111.0, 140.0, 131.0], [123.0, 85.0, 140.0, 103.0], [158.0, 121.0, 175.0, 139.0], [129.0, 184.0, 146.0, 202.0], [336.0, 461.0, 354.0, 480.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 366.0, 547.0, 384.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [393.0, 106.0, 410.0, 122.0], [463.0, 66.0, 480.0, 82.0], [446.0, 296.0, 463.0, 313.0], [304.0, 286.0, 323.0, 302.0], [285.0, 219.0, 302.0, 235.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 354.0, 324.0, 375.0], [425.0, 458.0, 444.0, 477.0], [112.0, 331.0, 128.0, 350.0], [300.0, 17.0, 316.0, 30.0], [316.0, 6.0, 335.0, 21.0], [221.0, 23.0, 236.0, 37.0], [500.0, 182.0, 522.0, 201.0], [612.0, 10.0, 628.0, 28.0]], "label": "normal sperm"}
```


[User] <image> Show me where the sperm clusters are

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Mark the sperm cluster with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> Can you see any cluster in the image? How many are there?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Point to and count the cluster in the picture.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Count the cluster and enclose each in a bounding box.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> I am looking for sperms. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [163.5, 95.0], "label": "sperm"}, {"point_2d": [135.5, 88.0], "label": "sperm"}, {"point_2d": [170.5, 122.0], "label": "sperm"}, {"point_2d": [143.5, 189.0], "label": "sperm"}, {"point_2d": [345.0, 470.5], "label": "sperm"}, {"point_2d": [402.5, 292.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [538.5, 368.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [402.5, 114.0], "label": "sperm"}, {"point_2d": [474.5, 66.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [321.5, 291.0], "label": "sperm"}, {"point_2d": [293.5, 222.0], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [310.5, 363.5], "label": "sperm"}, {"point_2d": [482.5, 433.5], "label": "sperm"}, {"point_2d": [123.0, 386.5], "label": "sperm"}, {"point_2d": [308.0, 23.5], "label": "sperm"}, {"point_2d": [325.5, 12.5], "label": "sperm"}, {"point_2d": [228.5, 30.0], "label": "sperm"}, {"point_2d": [497.0, 124.5], "label": "sperm"}, {"point_2d": [624.5, 15.0], "label": "sperm"}]
```


[User] <image> Mark the normal sperm with a rectangle and supply the bounding box coordinates.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [155.0, 85.0, 172.0, 105.0], "label": "normal sperm"}, {"bbox_2d": [127.0, 79.0, 144.0, 97.0], "label": "normal sperm"}, {"bbox_2d": [162.0, 113.0, 179.0, 131.0], "label": "normal sperm"}, {"bbox_2d": [135.0, 180.0, 152.0, 198.0], "label": "normal sperm"}, {"bbox_2d": [336.0, 461.0, 354.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 283.0, 411.0, 301.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [530.0, 359.0, 547.0, 377.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 106.0, 411.0, 122.0], "label": "normal sperm"}, {"bbox_2d": [466.0, 58.0, 483.0, 74.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [312.0, 283.0, 331.0, 299.0], "label": "normal sperm"}, {"bbox_2d": [285.0, 214.0, 302.0, 230.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [297.0, 353.0, 324.0, 374.0], "label": "normal sperm"}, {"bbox_2d": [473.0, 424.0, 492.0, 443.0], "label": "normal sperm"}, {"bbox_2d": [115.0, 377.0, 131.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [300.0, 17.0, 316.0, 30.0], "label": "normal sperm"}, {"bbox_2d": [316.0, 5.0, 335.0, 20.0], "label": "normal sperm"}, {"bbox_2d": [221.0, 23.0, 236.0, 37.0], "label": "normal sperm"}, {"bbox_2d": [486.0, 115.0, 508.0, 134.0], "label": "normal sperm"}, {"bbox_2d": [617.0, 7.0, 632.0, 23.0], "label": "normal sperm"}]
```


[User]
<image> Object: normal sperm
Instruction: Point to the object and output the total count.

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> How many sperm are there? Point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [86.5, 90.5], [163.5, 95.0], [135.5, 88.0], [170.5, 122.0], [143.5, 189.0], [345.0, 470.5], [402.5, 292.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [538.5, 368.0], [530.0, 209.5], [553.0, 196.5], [402.5, 114.0], [474.5, 66.0], [454.5, 304.5], [321.5, 291.0], [293.5, 222.0], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [310.5, 363.5], [482.5, 433.5], [123.0, 386.5], [308.0, 23.5], [325.5, 12.5], [228.5, 30.0], [497.0, 124.5], [624.5, 15.0]], "label": "normal sperm"}
```


[User] <image> Count all sperm in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [78.0, 82.0, 95.0, 99.0], [155.0, 85.0, 172.0, 105.0], [127.0, 79.0, 144.0, 97.0], [162.0, 113.0, 179.0, 131.0], [135.0, 180.0, 152.0, 198.0], [336.0, 461.0, 354.0, 480.0], [394.0, 283.0, 411.0, 301.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [530.0, 359.0, 547.0, 377.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [394.0, 106.0, 411.0, 122.0], [466.0, 58.0, 483.0, 74.0], [446.0, 296.0, 463.0, 313.0], [312.0, 283.0, 331.0, 299.0], [285.0, 214.0, 302.0, 230.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [297.0, 353.0, 324.0, 374.0], [473.0, 424.0, 492.0, 443.0], [115.0, 377.0, 131.0, 396.0], [300.0, 17.0, 316.0, 30.0], [316.0, 5.0, 335.0, 20.0], [221.0, 23.0, 236.0, 37.0], [486.0, 115.0, 508.0, 134.0], [617.0, 7.0, 632.0, 23.0]], "label": "normal sperm"}
```


[User]
<image> Point to sperm cluster.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Outline the area containing cluster by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Locate every sperm cluster and count them

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Identify all occurrences of sperm cluster by marking them, and then provide the count.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Return bounding boxes for each sperm cluster in the image and the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> I am looking for normal sperms. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [135.5, 111.0], "label": "normal sperm"}, {"point_2d": [132.5, 92.0], "label": "normal sperm"}, {"point_2d": [167.5, 127.0], "label": "normal sperm"}, {"point_2d": [138.5, 192.0], "label": "normal sperm"}, {"point_2d": [345.0, 470.5], "label": "normal sperm"}, {"point_2d": [401.5, 291.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [538.5, 373.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [401.5, 114.0], "label": "normal sperm"}, {"point_2d": [471.5, 72.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [315.5, 293.0], "label": "normal sperm"}, {"point_2d": [293.5, 225.0], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [310.5, 363.5], "label": "normal sperm"}, {"point_2d": [448.5, 458.5], "label": "normal sperm"}, {"point_2d": [130.0, 347.5], "label": "normal sperm"}, {"point_2d": [308.0, 23.5], "label": "normal sperm"}, {"point_2d": [325.5, 13.5], "label": "normal sperm"}, {"point_2d": [228.5, 30.0], "label": "normal sperm"}, {"point_2d": [504.0, 176.5], "label": "normal sperm"}, {"point_2d": [621.5, 17.5], "label": "normal sperm"}]
```