[User] <image> Identify all sperm in the image, count them, and provide bounding box coordinates for each.

[Assistant]
```json
{"count": 43, "bbox_2d": [[167.0, 189.0, 184.0, 207.0], [144.0, 270.0, 161.0, 288.0], [148.0, 398.0, 165.0, 416.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [10.0, 340.0, 27.0, 358.0], [78.0, 82.0, 95.0, 99.0], [115.0, 44.0, 132.0, 62.0], [191.0, 36.0, 208.0, 54.0], [173.0, 95.0, 190.0, 113.0], [192.0, 137.0, 209.0, 155.0], [264.0, 36.0, 281.0, 54.0], [366.0, 410.0, 383.0, 428.0], [405.0, 261.0, 422.0, 279.0], [304.0, 408.0, 321.0, 426.0], [287.0, 364.0, 304.0, 382.0], [534.0, 393.0, 551.0, 411.0], [528.0, 453.0, 545.0, 471.0], [538.0, 350.0, 555.0, 368.0], [553.0, 314.0, 570.0, 332.0], [522.0, 200.0, 538.0, 219.0], [547.0, 187.0, 563.0, 206.0], [422.0, 81.0, 437.0, 97.0], [422.0, 54.0, 439.0, 70.0], [468.0, 32.0, 485.0, 47.0], [484.0, 22.0, 501.0, 38.0], [447.0, 298.0, 464.0, 314.0], [368.0, 222.0, 385.0, 238.0], [311.0, 176.0, 328.0, 192.0], [102.0, 287.0, 119.0, 303.0], [1.0, 95.0, 18.0, 111.0], [34.0, 84.0, 51.0, 100.0], [453.0, 470.0, 465.0, 480.0], [409.0, 448.0, 426.0, 465.0], [461.0, 396.0, 478.0, 412.0], [623.0, 361.0, 640.0, 377.0], [342.0, 109.0, 358.0, 126.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [231.0, 352.0, 256.0, 372.0], [502.0, 301.0, 520.0, 317.0], [536.0, 97.0, 560.0, 118.0], [315.0, 333.0, 342.0, 354.0]], "label": "sperm"}
```


[User] <image> Show me where the normal sperms are

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [154.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [7.5, 370.5], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [194.5, 120.0], "label": "normal sperm"}, {"point_2d": [155.5, 74.0], "label": "normal sperm"}, {"point_2d": [179.5, 106.0], "label": "normal sperm"}, {"point_2d": [170.5, 173.0], "label": "normal sperm"}, {"point_2d": [341.5, 467.0], "label": "normal sperm"}, {"point_2d": [401.5, 290.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [543.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [554.0, 196.5], "label": "normal sperm"}, {"point_2d": [421.5, 96.0], "label": "normal sperm"}, {"point_2d": [489.5, 44.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [354.5, 266.0], "label": "normal sperm"}, {"point_2d": [304.5, 199.0], "label": "normal sperm"}, {"point_2d": [417.0, 245.5], "label": "normal sperm"}, {"point_2d": [615.5, 425.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [541.5, 68.0], "label": "normal sperm"}, {"point_2d": [315.5, 358.5], "label": "normal sperm"}, {"point_2d": [320.0, 14.5], "label": "normal sperm"}, {"point_2d": [324.5, 6.5], "label": "normal sperm"}, {"point_2d": [232.5, 16.5], "label": "normal sperm"}]
```


[User] <image> Find the region corresponding to normal sperm and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 362.0, 15.0, 379.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [186.0, 110.0, 203.0, 130.0], "label": "normal sperm"}, {"bbox_2d": [147.0, 65.0, 164.0, 83.0], "label": "normal sperm"}, {"bbox_2d": [171.0, 97.0, 188.0, 115.0], "label": "normal sperm"}, {"bbox_2d": [162.0, 164.0, 179.0, 182.0], "label": "normal sperm"}, {"bbox_2d": [333.0, 458.0, 350.0, 476.0], "label": "normal sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [535.0, 353.0, 552.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [546.0, 187.0, 562.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [413.0, 88.0, 430.0, 104.0], "label": "normal sperm"}, {"bbox_2d": [481.0, 36.0, 498.0, 52.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [345.0, 258.0, 364.0, 274.0], "label": "normal sperm"}, {"bbox_2d": [296.0, 191.0, 313.0, 207.0], "label": "normal sperm"}, {"bbox_2d": [408.0, 236.0, 426.0, 255.0], "label": "normal sperm"}, {"bbox_2d": [608.0, 417.0, 623.0, 434.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 59.0, 552.0, 77.0], "label": "normal sperm"}, {"bbox_2d": [302.0, 348.0, 329.0, 369.0], "label": "normal sperm"}, {"bbox_2d": [312.0, 8.0, 328.0, 21.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 2.0, 334.0, 11.0], "label": "normal sperm"}, {"bbox_2d": [225.0, 10.0, 240.0, 23.0], "label": "normal sperm"}]
```


[User] <image> Generate list of points showing where the normal sperm are and output the total count.

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Show me each sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [7.5, 370.5], [86.5, 90.5], [194.5, 120.0], [155.5, 74.0], [179.5, 106.0], [170.5, 173.0], [341.5, 467.0], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [543.5, 362.0], [530.0, 209.5], [554.0, 196.5], [421.5, 96.0], [489.5, 44.0], [454.5, 304.5], [354.5, 266.0], [304.5, 199.0], [417.0, 245.5], [615.5, 425.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [541.5, 68.0], [315.5, 358.5], [320.0, 14.5], [324.5, 6.5], [232.5, 16.5]], "label": "normal sperm"}
```


[User] <image> Return both the count and the bounding boxes of all sperm in the image.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 362.0, 15.0, 379.0], [78.0, 82.0, 95.0, 99.0], [186.0, 110.0, 203.0, 130.0], [147.0, 65.0, 164.0, 83.0], [171.0, 97.0, 188.0, 115.0], [162.0, 164.0, 179.0, 182.0], [333.0, 458.0, 350.0, 476.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [535.0, 353.0, 552.0, 371.0], [522.0, 200.0, 538.0, 219.0], [546.0, 187.0, 562.0, 206.0], [413.0, 88.0, 430.0, 104.0], [481.0, 36.0, 498.0, 52.0], [446.0, 296.0, 463.0, 313.0], [345.0, 258.0, 364.0, 274.0], [296.0, 191.0, 313.0, 207.0], [408.0, 236.0, 426.0, 255.0], [608.0, 417.0, 623.0, 434.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [531.0, 59.0, 552.0, 77.0], [302.0, 348.0, 329.0, 369.0], [312.0, 8.0, 328.0, 21.0], [315.0, 2.0, 334.0, 11.0], [225.0, 10.0, 240.0, 23.0]], "label": "normal sperm"}
```


[User] <image> show me all visible clusters

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Enclose cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Find all the sperm cluster. How many are there?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Locate the sperm cluster and count them, then point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Find all sperm cluster in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Look for normal sperms in the image and show me where they are.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [3.5, 383.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [206.0, 108.0], "label": "normal sperm"}, {"point_2d": [153.5, 80.0], "label": "normal sperm"}, {"point_2d": [176.5, 110.0], "label": "normal sperm"}, {"point_2d": [157.5, 178.0], "label": "normal sperm"}, {"point_2d": [342.5, 468.0], "label": "normal sperm"}, {"point_2d": [402.5, 291.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [540.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [411.5, 111.0], "label": "normal sperm"}, {"point_2d": [486.5, 48.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [341.5, 281.0], "label": "normal sperm"}, {"point_2d": [298.5, 206.0], "label": "normal sperm"}, {"point_2d": [524.0, 194.0], "label": "normal sperm"}, {"point_2d": [605.5, 450.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [314.5, 359.5], "label": "normal sperm"}, {"point_2d": [605.0, 203.5], "label": "normal sperm"}, {"point_2d": [311.0, 20.5], "label": "normal sperm"}, {"point_2d": [324.5, 10.0], "label": "normal sperm"}, {"point_2d": [229.5, 25.5], "label": "normal sperm"}]
```


[User] <image> Find the sperm in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [0.0, 375.0, 7.0, 391.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [197.0, 98.0, 215.0, 118.0], "label": "sperm"}, {"bbox_2d": [145.0, 71.0, 162.0, 89.0], "label": "sperm"}, {"bbox_2d": [168.0, 101.0, 185.0, 119.0], "label": "sperm"}, {"bbox_2d": [149.0, 169.0, 166.0, 187.0], "label": "sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [532.0, 353.0, 549.0, 371.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [403.0, 103.0, 420.0, 119.0], "label": "sperm"}, {"bbox_2d": [478.0, 40.0, 495.0, 56.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [332.0, 273.0, 351.0, 289.0], "label": "sperm"}, {"bbox_2d": [290.0, 198.0, 307.0, 214.0], "label": "sperm"}, {"bbox_2d": [515.0, 185.0, 533.0, 203.0], "label": "sperm"}, {"bbox_2d": [598.0, 442.0, 613.0, 459.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "sperm"}, {"bbox_2d": [596.0, 193.0, 614.0, 214.0], "label": "sperm"}, {"bbox_2d": [303.0, 14.0, 319.0, 27.0], "label": "sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 17.0], "label": "sperm"}, {"bbox_2d": [222.0, 19.0, 237.0, 32.0], "label": "sperm"}]
```


[User] <image> How many sperm are there?

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Count the sperm in the image, then point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 383.0], [86.5, 90.5], [206.0, 108.0], [153.5, 80.0], [176.5, 110.0], [157.5, 178.0], [342.5, 468.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [540.5, 362.0], [530.0, 209.5], [553.0, 196.5], [411.5, 111.0], [486.5, 48.0], [454.5, 304.5], [341.5, 281.0], [298.5, 206.0], [524.0, 194.0], [605.5, 450.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [605.0, 203.5], [311.0, 20.5], [324.5, 10.0], [229.5, 25.5]], "label": "sperm"}
```


[User] <image> Output a list of bounding boxes for every sperm and the overall count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 375.0, 7.0, 391.0], [78.0, 82.0, 95.0, 99.0], [197.0, 98.0, 215.0, 118.0], [145.0, 71.0, 162.0, 89.0], [168.0, 101.0, 185.0, 119.0], [149.0, 169.0, 166.0, 187.0], [334.0, 459.0, 351.0, 477.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [532.0, 353.0, 549.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [403.0, 103.0, 420.0, 119.0], [478.0, 40.0, 495.0, 56.0], [446.0, 296.0, 463.0, 313.0], [332.0, 273.0, 351.0, 289.0], [290.0, 198.0, 307.0, 214.0], [515.0, 185.0, 533.0, 203.0], [598.0, 442.0, 613.0, 459.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [596.0, 193.0, 614.0, 214.0], [303.0, 14.0, 319.0, 27.0], [315.0, 3.0, 334.0, 17.0], [222.0, 19.0, 237.0, 32.0]], "label": "sperm"}
```


[User] <image> Point to all occurrences of "clusters"

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Locate the cluster and mark it with a bounding box in the image.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Can you see any sperm cluster in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Point out every cluster you see in the image, then tell me the total number.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Draw bounding boxes around every cluster and then provide the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Show me where a normal sperm is

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [154.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [7.5, 370.5], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [195.5, 121.0], "label": "normal sperm"}, {"point_2d": [155.5, 74.0], "label": "normal sperm"}, {"point_2d": [179.5, 106.0], "label": "normal sperm"}, {"point_2d": [170.5, 173.0], "label": "normal sperm"}, {"point_2d": [341.5, 467.0], "label": "normal sperm"}, {"point_2d": [401.5, 290.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [543.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [554.0, 196.5], "label": "normal sperm"}, {"point_2d": [421.5, 96.0], "label": "normal sperm"}, {"point_2d": [489.5, 44.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [354.5, 266.0], "label": "normal sperm"}, {"point_2d": [304.5, 199.0], "label": "normal sperm"}, {"point_2d": [417.0, 244.0], "label": "normal sperm"}, {"point_2d": [615.5, 425.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [540.5, 73.0], "label": "normal sperm"}, {"point_2d": [315.5, 358.5], "label": "normal sperm"}, {"point_2d": [320.0, 14.5], "label": "normal sperm"}, {"point_2d": [324.5, 6.5], "label": "normal sperm"}, {"point_2d": [232.5, 16.5], "label": "normal sperm"}]
```


[User] <image> Return the rectangular bounding box that covers sperm in the image.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [0.0, 362.0, 15.0, 379.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [187.0, 111.0, 204.0, 131.0], "label": "sperm"}, {"bbox_2d": [147.0, 65.0, 164.0, 83.0], "label": "sperm"}, {"bbox_2d": [171.0, 97.0, 188.0, 115.0], "label": "sperm"}, {"bbox_2d": [162.0, 164.0, 179.0, 182.0], "label": "sperm"}, {"bbox_2d": [333.0, 458.0, 350.0, 476.0], "label": "sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [535.0, 353.0, 552.0, 371.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [546.0, 187.0, 562.0, 206.0], "label": "sperm"}, {"bbox_2d": [413.0, 88.0, 430.0, 104.0], "label": "sperm"}, {"bbox_2d": [481.0, 36.0, 498.0, 52.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [345.0, 258.0, 364.0, 274.0], "label": "sperm"}, {"bbox_2d": [296.0, 191.0, 313.0, 207.0], "label": "sperm"}, {"bbox_2d": [408.0, 235.0, 426.0, 253.0], "label": "sperm"}, {"bbox_2d": [608.0, 417.0, 623.0, 434.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [530.0, 64.0, 551.0, 82.0], "label": "sperm"}, {"bbox_2d": [302.0, 348.0, 329.0, 369.0], "label": "sperm"}, {"bbox_2d": [312.0, 8.0, 328.0, 21.0], "label": "sperm"}, {"bbox_2d": [315.0, 2.0, 334.0, 11.0], "label": "sperm"}, {"bbox_2d": [225.0, 10.0, 240.0, 23.0], "label": "sperm"}]
```


[User] <image> how mmny normal sperm?

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Identify all occurrences of normal sperm by marking them, and then provide the count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [7.5, 370.5], [86.5, 90.5], [195.5, 121.0], [155.5, 74.0], [179.5, 106.0], [170.5, 173.0], [341.5, 467.0], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [543.5, 362.0], [530.0, 209.5], [554.0, 196.5], [421.5, 96.0], [489.5, 44.0], [454.5, 304.5], [354.5, 266.0], [304.5, 199.0], [417.0, 244.0], [615.5, 425.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [540.5, 73.0], [315.5, 358.5], [320.0, 14.5], [324.5, 6.5], [232.5, 16.5]], "label": "normal sperm"}
```


[User] <image> Detect all normal sperm in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 362.0, 15.0, 379.0], [78.0, 82.0, 95.0, 99.0], [187.0, 111.0, 204.0, 131.0], [147.0, 65.0, 164.0, 83.0], [171.0, 97.0, 188.0, 115.0], [162.0, 164.0, 179.0, 182.0], [333.0, 458.0, 350.0, 476.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [535.0, 353.0, 552.0, 371.0], [522.0, 200.0, 538.0, 219.0], [546.0, 187.0, 562.0, 206.0], [413.0, 88.0, 430.0, 104.0], [481.0, 36.0, 498.0, 52.0], [446.0, 296.0, 463.0, 313.0], [345.0, 258.0, 364.0, 274.0], [296.0, 191.0, 313.0, 207.0], [408.0, 235.0, 426.0, 253.0], [608.0, 417.0, 623.0, 434.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [530.0, 64.0, 551.0, 82.0], [302.0, 348.0, 329.0, 369.0], [312.0, 8.0, 328.0, 21.0], [315.0, 2.0, 334.0, 11.0], [225.0, 10.0, 240.0, 23.0]], "label": "normal sperm"}
```


[User] <image> Show me where the sperm clusters are

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Specify the bounding box for the sperm cluster in the image.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> Where are the cluster? How many are there?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Point to each instance of cluster and then output their total number.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Count all cluster in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Generate a list of points showing where the sperms are.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [3.5, 383.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [203.5, 107.0], "label": "sperm"}, {"point_2d": [153.5, 80.0], "label": "sperm"}, {"point_2d": [176.5, 110.0], "label": "sperm"}, {"point_2d": [157.5, 178.0], "label": "sperm"}, {"point_2d": [342.5, 468.0], "label": "sperm"}, {"point_2d": [402.5, 291.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [540.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [410.5, 111.0], "label": "sperm"}, {"point_2d": [485.5, 49.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [341.5, 281.0], "label": "sperm"}, {"point_2d": [298.5, 206.0], "label": "sperm"}, {"point_2d": [524.0, 197.0], "label": "sperm"}, {"point_2d": [604.5, 450.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [314.5, 359.5], "label": "sperm"}, {"point_2d": [603.0, 210.5], "label": "sperm"}, {"point_2d": [311.0, 20.5], "label": "sperm"}, {"point_2d": [324.5, 10.0], "label": "sperm"}, {"point_2d": [229.5, 25.5], "label": "sperm"}]
```


[User] <image> Outline the area containing normal sperm by returning a bounding box.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 375.0, 7.0, 391.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [195.0, 97.0, 212.0, 117.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 71.0, 162.0, 89.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 101.0, 185.0, 119.0], "label": "normal sperm"}, {"bbox_2d": [149.0, 169.0, 166.0, 187.0], "label": "normal sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [532.0, 353.0, 549.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [402.0, 103.0, 419.0, 119.0], "label": "normal sperm"}, {"bbox_2d": [477.0, 41.0, 494.0, 57.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [332.0, 273.0, 351.0, 289.0], "label": "normal sperm"}, {"bbox_2d": [290.0, 198.0, 307.0, 214.0], "label": "normal sperm"}, {"bbox_2d": [515.0, 188.0, 533.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [597.0, 442.0, 612.0, 459.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [594.0, 200.0, 612.0, 221.0], "label": "normal sperm"}, {"bbox_2d": [303.0, 14.0, 319.0, 27.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 17.0], "label": "normal sperm"}, {"bbox_2d": [222.0, 19.0, 237.0, 32.0], "label": "normal sperm"}]
```


[User] <image> How many sperm are visible?

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Mark all visible sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 383.0], [86.5, 90.5], [203.5, 107.0], [153.5, 80.0], [176.5, 110.0], [157.5, 178.0], [342.5, 468.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [540.5, 362.0], [530.0, 209.5], [553.0, 196.5], [410.5, 111.0], [485.5, 49.0], [454.5, 304.5], [341.5, 281.0], [298.5, 206.0], [524.0, 197.0], [604.5, 450.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [603.0, 210.5], [311.0, 20.5], [324.5, 10.0], [229.5, 25.5]], "label": "sperm"}
```


[User] <image> Count all sperm in the image and provide their bounding boxes.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 375.0, 7.0, 391.0], [78.0, 82.0, 95.0, 99.0], [195.0, 97.0, 212.0, 117.0], [145.0, 71.0, 162.0, 89.0], [168.0, 101.0, 185.0, 119.0], [149.0, 169.0, 166.0, 187.0], [334.0, 459.0, 351.0, 477.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [532.0, 353.0, 549.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [402.0, 103.0, 419.0, 119.0], [477.0, 41.0, 494.0, 57.0], [446.0, 296.0, 463.0, 313.0], [332.0, 273.0, 351.0, 289.0], [290.0, 198.0, 307.0, 214.0], [515.0, 188.0, 533.0, 206.0], [597.0, 442.0, 612.0, 459.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [594.0, 200.0, 612.0, 221.0], [303.0, 14.0, 319.0, 27.0], [315.0, 3.0, 334.0, 17.0], [222.0, 19.0, 237.0, 32.0]], "label": "sperm"}
```


[User] <image> If there is a cluster present, indicate its position.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Return a bounding box that encloses cluster.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> If there are any sperm cluster present, indicate their positions and output the total count.

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Mark each sperm cluster with a point, then output how many there are.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Count the sperm cluster and enclose each in a bounding box.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Locate a sperm.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [3.5, 384.5], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [202.5, 107.0], "label": "sperm"}, {"point_2d": [152.5, 81.0], "label": "sperm"}, {"point_2d": [175.5, 111.0], "label": "sperm"}, {"point_2d": [156.5, 179.0], "label": "sperm"}, {"point_2d": [343.5, 469.0], "label": "sperm"}, {"point_2d": [402.5, 292.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [539.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [408.5, 111.0], "label": "sperm"}, {"point_2d": [485.5, 49.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [338.5, 283.0], "label": "sperm"}, {"point_2d": [297.5, 207.0], "label": "sperm"}, {"point_2d": [544.0, 187.0], "label": "sperm"}, {"point_2d": [603.5, 454.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [313.5, 360.5], "label": "sperm"}, {"point_2d": [596.5, 235.5], "label": "sperm"}, {"point_2d": [310.0, 21.5], "label": "sperm"}, {"point_2d": [324.5, 10.5], "label": "sperm"}, {"point_2d": [229.5, 26.5], "label": "sperm"}]
```


[User] <image> Mark the object sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [0.0, 377.0, 7.0, 392.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [194.0, 97.0, 211.0, 117.0], "label": "sperm"}, {"bbox_2d": [144.0, 72.0, 161.0, 90.0], "label": "sperm"}, {"bbox_2d": [167.0, 102.0, 184.0, 120.0], "label": "sperm"}, {"bbox_2d": [148.0, 170.0, 165.0, 188.0], "label": "sperm"}, {"bbox_2d": [335.0, 460.0, 352.0, 478.0], "label": "sperm"}, {"bbox_2d": [394.0, 283.0, 411.0, 301.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [531.0, 353.0, 548.0, 371.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [400.0, 103.0, 417.0, 119.0], "label": "sperm"}, {"bbox_2d": [477.0, 41.0, 494.0, 57.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [329.0, 275.0, 348.0, 291.0], "label": "sperm"}, {"bbox_2d": [289.0, 199.0, 306.0, 215.0], "label": "sperm"}, {"bbox_2d": [535.0, 178.0, 553.0, 196.0], "label": "sperm"}, {"bbox_2d": [596.0, 446.0, 611.0, 463.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [300.0, 350.0, 327.0, 371.0], "label": "sperm"}, {"bbox_2d": [588.0, 227.0, 605.0, 244.0], "label": "sperm"}, {"bbox_2d": [302.0, 15.0, 318.0, 28.0], "label": "sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 18.0], "label": "sperm"}, {"bbox_2d": [222.0, 20.0, 237.0, 33.0], "label": "sperm"}]
```


[User] <image> Can you see any sperm in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Count every normal sperm in the picture, then point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 384.5], [86.5, 90.5], [202.5, 107.0], [152.5, 81.0], [175.5, 111.0], [156.5, 179.0], [343.5, 469.0], [402.5, 292.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [539.5, 362.0], [530.0, 209.5], [553.0, 196.5], [408.5, 111.0], [485.5, 49.0], [454.5, 304.5], [338.5, 283.0], [297.5, 207.0], [544.0, 187.0], [603.5, 454.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [313.5, 360.5], [596.5, 235.5], [310.0, 21.5], [324.5, 10.5], [229.5, 26.5]], "label": "sperm"}
```


[User] <image> Draw bounding boxes around every normal sperm and then provide the total count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 377.0, 7.0, 392.0], [78.0, 82.0, 95.0, 99.0], [194.0, 97.0, 211.0, 117.0], [144.0, 72.0, 161.0, 90.0], [167.0, 102.0, 184.0, 120.0], [148.0, 170.0, 165.0, 188.0], [335.0, 460.0, 352.0, 478.0], [394.0, 283.0, 411.0, 301.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [531.0, 353.0, 548.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [400.0, 103.0, 417.0, 119.0], [477.0, 41.0, 494.0, 57.0], [446.0, 296.0, 463.0, 313.0], [329.0, 275.0, 348.0, 291.0], [289.0, 199.0, 306.0, 215.0], [535.0, 178.0, 553.0, 196.0], [596.0, 446.0, 611.0, 463.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [300.0, 350.0, 327.0, 371.0], [588.0, 227.0, 605.0, 244.0], [302.0, 15.0, 318.0, 28.0], [315.0, 3.0, 334.0, 18.0], [222.0, 20.0, 237.0, 33.0]], "label": "sperm"}
```


[User] <image> Locate sperm cluster.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Identify sperm cluster and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> count every sperm cluster

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Point to each instance of sperm cluster and then output their total number.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Return bounding boxes for each sperm cluster in the image and the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User]
<image> Object: sperm
Instruction: Point to the object.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [154.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [6.0, 373.5], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [198.5, 120.5], "label": "sperm"}, {"point_2d": [155.5, 75.0], "label": "sperm"}, {"point_2d": [179.5, 106.0], "label": "sperm"}, {"point_2d": [166.5, 174.0], "label": "sperm"}, {"point_2d": [342.5, 468.0], "label": "sperm"}, {"point_2d": [401.5, 290.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [542.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [554.0, 196.5], "label": "sperm"}, {"point_2d": [419.5, 100.0], "label": "sperm"}, {"point_2d": [488.5, 45.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [353.5, 270.0], "label": "sperm"}, {"point_2d": [303.5, 200.0], "label": "sperm"}, {"point_2d": [442.5, 249.0], "label": "sperm"}, {"point_2d": [614.5, 430.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [532.5, 41.5], "label": "sperm"}, {"point_2d": [315.5, 358.5], "label": "sperm"}, {"point_2d": [318.0, 15.5], "label": "sperm"}, {"point_2d": [324.5, 7.5], "label": "sperm"}, {"point_2d": [232.5, 18.5], "label": "sperm"}]
```


[User] <image> Specify the bounding box for the normal sperm in the image.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 365.0, 12.0, 382.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [190.0, 110.0, 207.0, 131.0], "label": "normal sperm"}, {"bbox_2d": [147.0, 66.0, 164.0, 84.0], "label": "normal sperm"}, {"bbox_2d": [171.0, 97.0, 188.0, 115.0], "label": "normal sperm"}, {"bbox_2d": [158.0, 165.0, 175.0, 183.0], "label": "normal sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "normal sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [534.0, 353.0, 551.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [546.0, 187.0, 562.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [411.0, 92.0, 428.0, 108.0], "label": "normal sperm"}, {"bbox_2d": [480.0, 37.0, 497.0, 53.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [344.0, 262.0, 363.0, 278.0], "label": "normal sperm"}, {"bbox_2d": [295.0, 192.0, 312.0, 208.0], "label": "normal sperm"}, {"bbox_2d": [434.0, 240.0, 451.0, 258.0], "label": "normal sperm"}, {"bbox_2d": [607.0, 422.0, 622.0, 439.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [523.0, 34.0, 542.0, 49.0], "label": "normal sperm"}, {"bbox_2d": [302.0, 348.0, 329.0, 369.0], "label": "normal sperm"}, {"bbox_2d": [310.0, 9.0, 326.0, 22.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 12.0], "label": "normal sperm"}, {"bbox_2d": [225.0, 12.0, 240.0, 25.0], "label": "normal sperm"}]
```


[User] <image> Can you count the number of sperm in the image?

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Mark all visible sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [6.0, 373.5], [86.5, 90.5], [198.5, 120.5], [155.5, 75.0], [179.5, 106.0], [166.5, 174.0], [342.5, 468.0], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [542.5, 362.0], [530.0, 209.5], [554.0, 196.5], [419.5, 100.0], [488.5, 45.0], [454.5, 304.5], [353.5, 270.0], [303.5, 200.0], [442.5, 249.0], [614.5, 430.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [532.5, 41.5], [315.5, 358.5], [318.0, 15.5], [324.5, 7.5], [232.5, 18.5]], "label": "sperm"}
```


[User] <image> Mark all sperm with a bounding box, then count how many are present.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 365.0, 12.0, 382.0], [78.0, 82.0, 95.0, 99.0], [190.0, 110.0, 207.0, 131.0], [147.0, 66.0, 164.0, 84.0], [171.0, 97.0, 188.0, 115.0], [158.0, 165.0, 175.0, 183.0], [334.0, 459.0, 351.0, 477.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [534.0, 353.0, 551.0, 371.0], [522.0, 200.0, 538.0, 219.0], [546.0, 187.0, 562.0, 206.0], [411.0, 92.0, 428.0, 108.0], [480.0, 37.0, 497.0, 53.0], [446.0, 296.0, 463.0, 313.0], [344.0, 262.0, 363.0, 278.0], [295.0, 192.0, 312.0, 208.0], [434.0, 240.0, 451.0, 258.0], [607.0, 422.0, 622.0, 439.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [523.0, 34.0, 542.0, 49.0], [302.0, 348.0, 329.0, 369.0], [310.0, 9.0, 326.0, 22.0], [315.0, 3.0, 334.0, 12.0], [225.0, 12.0, 240.0, 25.0]], "label": "sperm"}
```


[User] <image> Locate an cluster.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Find the region corresponding to cluster and provide the bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> count every sperm cluster

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Point to each instance of cluster and then output their total number.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Output the total count of cluster in the image along with bounding boxes for each.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> show me all visible sperms

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [3.5, 380.5], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [201.0, 109.5], "label": "sperm"}, {"point_2d": [153.5, 79.0], "label": "sperm"}, {"point_2d": [177.5, 108.0], "label": "sperm"}, {"point_2d": [159.5, 177.0], "label": "sperm"}, {"point_2d": [342.5, 468.0], "label": "sperm"}, {"point_2d": [402.5, 291.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [541.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [412.5, 108.0], "label": "sperm"}, {"point_2d": [487.5, 48.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [345.5, 278.0], "label": "sperm"}, {"point_2d": [300.5, 204.0], "label": "sperm"}, {"point_2d": [490.0, 190.5], "label": "sperm"}, {"point_2d": [607.5, 445.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [314.5, 359.5], "label": "sperm"}, {"point_2d": [630.0, 182.0], "label": "sperm"}, {"point_2d": [314.0, 18.5], "label": "sperm"}, {"point_2d": [324.5, 8.5], "label": "sperm"}, {"point_2d": [230.5, 23.5], "label": "sperm"}]
```


[User] <image> Generate bounding box coordinates for the normal sperm.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 373.0, 7.0, 388.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [192.0, 99.0, 210.0, 120.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 70.0, 162.0, 88.0], "label": "normal sperm"}, {"bbox_2d": [169.0, 99.0, 186.0, 117.0], "label": "normal sperm"}, {"bbox_2d": [151.0, 168.0, 168.0, 186.0], "label": "normal sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [533.0, 353.0, 550.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [404.0, 100.0, 421.0, 116.0], "label": "normal sperm"}, {"bbox_2d": [479.0, 40.0, 496.0, 56.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [336.0, 270.0, 355.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [292.0, 196.0, 309.0, 212.0], "label": "normal sperm"}, {"bbox_2d": [481.0, 182.0, 499.0, 199.0], "label": "normal sperm"}, {"bbox_2d": [600.0, 437.0, 615.0, 454.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [621.0, 172.0, 639.0, 192.0], "label": "normal sperm"}, {"bbox_2d": [306.0, 12.0, 322.0, 25.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 2.0, 334.0, 15.0], "label": "normal sperm"}, {"bbox_2d": [223.0, 17.0, 238.0, 30.0], "label": "normal sperm"}]
```


[User] <image> If you see any sperm in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Mark all visible normal sperm in the image with a point and then provide the count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 380.5], [86.5, 90.5], [201.0, 109.5], [153.5, 79.0], [177.5, 108.0], [159.5, 177.0], [342.5, 468.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [541.5, 362.0], [530.0, 209.5], [553.0, 196.5], [412.5, 108.0], [487.5, 48.0], [454.5, 304.5], [345.5, 278.0], [300.5, 204.0], [490.0, 190.5], [607.5, 445.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [630.0, 182.0], [314.0, 18.5], [324.5, 8.5], [230.5, 23.5]], "label": "sperm"}
```


[User] <image> Identify all normal sperm in the image, count them, and provide bounding box coordinates for each.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 373.0, 7.0, 388.0], [78.0, 82.0, 95.0, 99.0], [192.0, 99.0, 210.0, 120.0], [145.0, 70.0, 162.0, 88.0], [169.0, 99.0, 186.0, 117.0], [151.0, 168.0, 168.0, 186.0], [334.0, 459.0, 351.0, 477.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [533.0, 353.0, 550.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [404.0, 100.0, 421.0, 116.0], [479.0, 40.0, 496.0, 56.0], [446.0, 296.0, 463.0, 313.0], [336.0, 270.0, 355.0, 286.0], [292.0, 196.0, 309.0, 212.0], [481.0, 182.0, 499.0, 199.0], [600.0, 437.0, 615.0, 454.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [621.0, 172.0, 639.0, 192.0], [306.0, 12.0, 322.0, 25.0], [315.0, 2.0, 334.0, 15.0], [223.0, 17.0, 238.0, 30.0]], "label": "sperm"}
```


[User] <image> Point: Where are the sperm clusters?

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Find the sperm cluster in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> Point to and count the sperm cluster in the picture.

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Count every sperm cluster in the picture, then point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Detect all sperm cluster in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User]
<image> Point to normal sperm.
Please say 'This isn't in the image.' if it is not in the image.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [3.5, 383.5], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [203.5, 107.0], "label": "normal sperm"}, {"point_2d": [153.5, 81.0], "label": "normal sperm"}, {"point_2d": [176.5, 111.0], "label": "normal sperm"}, {"point_2d": [157.5, 178.0], "label": "normal sperm"}, {"point_2d": [343.5, 469.0], "label": "normal sperm"}, {"point_2d": [402.5, 291.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [540.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [410.5, 111.0], "label": "normal sperm"}, {"point_2d": [485.5, 49.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [340.5, 281.0], "label": "normal sperm"}, {"point_2d": [298.5, 206.0], "label": "normal sperm"}, {"point_2d": [527.0, 199.0], "label": "normal sperm"}, {"point_2d": [604.5, 451.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [314.5, 359.5], "label": "normal sperm"}, {"point_2d": [608.0, 217.5], "label": "normal sperm"}, {"point_2d": [311.0, 20.5], "label": "normal sperm"}, {"point_2d": [324.5, 10.0], "label": "normal sperm"}, {"point_2d": [229.5, 25.5], "label": "normal sperm"}]
```


[User] <image> Generate bounding box coordinates for the normal sperm.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 376.0, 7.0, 391.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [195.0, 97.0, 212.0, 117.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 72.0, 162.0, 90.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 102.0, 185.0, 120.0], "label": "normal sperm"}, {"bbox_2d": [149.0, 169.0, 166.0, 187.0], "label": "normal sperm"}, {"bbox_2d": [335.0, 460.0, 352.0, 478.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [532.0, 353.0, 549.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [402.0, 103.0, 419.0, 119.0], "label": "normal sperm"}, {"bbox_2d": [477.0, 41.0, 494.0, 57.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [331.0, 273.0, 350.0, 289.0], "label": "normal sperm"}, {"bbox_2d": [290.0, 198.0, 307.0, 214.0], "label": "normal sperm"}, {"bbox_2d": [518.0, 190.0, 536.0, 208.0], "label": "normal sperm"}, {"bbox_2d": [597.0, 443.0, 612.0, 460.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "normal sperm"}, {"bbox_2d": [599.0, 207.0, 617.0, 228.0], "label": "normal sperm"}, {"bbox_2d": [303.0, 14.0, 319.0, 27.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 17.0], "label": "normal sperm"}, {"bbox_2d": [222.0, 19.0, 237.0, 32.0], "label": "normal sperm"}]
```


[User] <image> If you see any normal sperm in the image, give me the count. Otherwise, say 'This isn't in the image.'

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Count every normal sperm in the picture, then point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 383.5], [86.5, 90.5], [203.5, 107.0], [153.5, 81.0], [176.5, 111.0], [157.5, 178.0], [343.5, 469.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [540.5, 362.0], [530.0, 209.5], [553.0, 196.5], [410.5, 111.0], [485.5, 49.0], [454.5, 304.5], [340.5, 281.0], [298.5, 206.0], [527.0, 199.0], [604.5, 451.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [608.0, 217.5], [311.0, 20.5], [324.5, 10.0], [229.5, 25.5]], "label": "normal sperm"}
```


[User] <image> Detect all normal sperm in the image, and for each, output its bounding box. Also, provide the total count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 376.0, 7.0, 391.0], [78.0, 82.0, 95.0, 99.0], [195.0, 97.0, 212.0, 117.0], [145.0, 72.0, 162.0, 90.0], [168.0, 102.0, 185.0, 120.0], [149.0, 169.0, 166.0, 187.0], [335.0, 460.0, 352.0, 478.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [532.0, 353.0, 549.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [402.0, 103.0, 419.0, 119.0], [477.0, 41.0, 494.0, 57.0], [446.0, 296.0, 463.0, 313.0], [331.0, 273.0, 350.0, 289.0], [290.0, 198.0, 307.0, 214.0], [518.0, 190.0, 536.0, 208.0], [597.0, 443.0, 612.0, 460.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [599.0, 207.0, 617.0, 228.0], [303.0, 14.0, 319.0, 27.0], [315.0, 3.0, 334.0, 17.0], [222.0, 19.0, 237.0, 32.0]], "label": "normal sperm"}
```


[User] <image> Point to any clusters in the image.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Enclose cluster in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> count every sperm cluster

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Count every sperm cluster in the picture, then point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Return both the count and the bounding boxes of all sperm cluster in the image.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Find a "normal sperm".

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [3.5, 384.5], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [202.5, 107.0], "label": "normal sperm"}, {"point_2d": [152.5, 81.0], "label": "normal sperm"}, {"point_2d": [176.5, 111.0], "label": "normal sperm"}, {"point_2d": [156.5, 179.0], "label": "normal sperm"}, {"point_2d": [343.5, 469.0], "label": "normal sperm"}, {"point_2d": [402.5, 292.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [539.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [409.5, 111.0], "label": "normal sperm"}, {"point_2d": [485.5, 49.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [339.5, 282.0], "label": "normal sperm"}, {"point_2d": [298.5, 206.0], "label": "normal sperm"}, {"point_2d": [536.0, 175.0], "label": "normal sperm"}, {"point_2d": [603.5, 453.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [313.5, 360.5], "label": "normal sperm"}, {"point_2d": [598.5, 225.0], "label": "normal sperm"}, {"point_2d": [310.0, 21.5], "label": "normal sperm"}, {"point_2d": [324.5, 10.5], "label": "normal sperm"}, {"point_2d": [229.5, 26.5], "label": "normal sperm"}]
```


[User] <image> Outline the normal sperm using a bounding box.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 377.0, 7.0, 392.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [194.0, 97.0, 211.0, 117.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 72.0, 161.0, 90.0], "label": "normal sperm"}, {"bbox_2d": [168.0, 102.0, 185.0, 120.0], "label": "normal sperm"}, {"bbox_2d": [148.0, 170.0, 165.0, 188.0], "label": "normal sperm"}, {"bbox_2d": [335.0, 460.0, 352.0, 478.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 283.0, 411.0, 301.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 353.0, 548.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [401.0, 103.0, 418.0, 119.0], "label": "normal sperm"}, {"bbox_2d": [477.0, 41.0, 494.0, 57.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [330.0, 274.0, 349.0, 290.0], "label": "normal sperm"}, {"bbox_2d": [290.0, 198.0, 307.0, 214.0], "label": "normal sperm"}, {"bbox_2d": [527.0, 166.0, 545.0, 184.0], "label": "normal sperm"}, {"bbox_2d": [596.0, 445.0, 611.0, 462.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [300.0, 350.0, 327.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [590.0, 216.0, 607.0, 234.0], "label": "normal sperm"}, {"bbox_2d": [302.0, 15.0, 318.0, 28.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 18.0], "label": "normal sperm"}, {"bbox_2d": [222.0, 20.0, 237.0, 33.0], "label": "normal sperm"}]
```


[User] <image> how many normal sperm.

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Count every sperm in the picture, then point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 384.5], [86.5, 90.5], [202.5, 107.0], [152.5, 81.0], [176.5, 111.0], [156.5, 179.0], [343.5, 469.0], [402.5, 292.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [539.5, 362.0], [530.0, 209.5], [553.0, 196.5], [409.5, 111.0], [485.5, 49.0], [454.5, 304.5], [339.5, 282.0], [298.5, 206.0], [536.0, 175.0], [603.5, 453.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [313.5, 360.5], [598.5, 225.0], [310.0, 21.5], [324.5, 10.5], [229.5, 26.5]], "label": "normal sperm"}
```


[User] <image> Return bounding boxes for each sperm in the image and the total count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 377.0, 7.0, 392.0], [78.0, 82.0, 95.0, 99.0], [194.0, 97.0, 211.0, 117.0], [144.0, 72.0, 161.0, 90.0], [168.0, 102.0, 185.0, 120.0], [148.0, 170.0, 165.0, 188.0], [335.0, 460.0, 352.0, 478.0], [394.0, 283.0, 411.0, 301.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [531.0, 353.0, 548.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [401.0, 103.0, 418.0, 119.0], [477.0, 41.0, 494.0, 57.0], [446.0, 296.0, 463.0, 313.0], [330.0, 274.0, 349.0, 290.0], [290.0, 198.0, 307.0, 214.0], [527.0, 166.0, 545.0, 184.0], [596.0, 445.0, 611.0, 462.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [300.0, 350.0, 327.0, 371.0], [590.0, 216.0, 607.0, 234.0], [302.0, 15.0, 318.0, 28.0], [315.0, 3.0, 334.0, 18.0], [222.0, 20.0, 237.0, 33.0]], "label": "normal sperm"}
```


[User]
<image> Help me find an object in the image by pointing to it.
Object: cluster.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Return the rectangular bounding box that covers sperm cluster in the image.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> How many cluster are there in the image? Point to them and output the total count.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Find each sperm cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Detect all sperm cluster in the image with bounding boxes, and then output their count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> I am looking for sperms. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [154.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [5.0, 375.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [197.5, 119.0], "label": "sperm"}, {"point_2d": [155.5, 76.0], "label": "sperm"}, {"point_2d": [179.5, 106.0], "label": "sperm"}, {"point_2d": [165.5, 175.0], "label": "sperm"}, {"point_2d": [342.5, 468.0], "label": "sperm"}, {"point_2d": [401.5, 290.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [542.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [554.0, 196.5], "label": "sperm"}, {"point_2d": [417.5, 102.0], "label": "sperm"}, {"point_2d": [488.5, 45.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [352.5, 272.0], "label": "sperm"}, {"point_2d": [302.5, 201.0], "label": "sperm"}, {"point_2d": [447.5, 235.0], "label": "sperm"}, {"point_2d": [613.5, 432.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [520.0, 48.0], "label": "sperm"}, {"point_2d": [315.5, 358.5], "label": "sperm"}, {"point_2d": [318.0, 15.5], "label": "sperm"}, {"point_2d": [324.5, 8.0], "label": "sperm"}, {"point_2d": [231.5, 19.5], "label": "sperm"}]
```


[User] <image> Draw a bounding box around normal sperm.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [146.0, 401.0, 163.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 367.0, 10.0, 383.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [189.0, 109.0, 206.0, 129.0], "label": "normal sperm"}, {"bbox_2d": [147.0, 67.0, 164.0, 85.0], "label": "normal sperm"}, {"bbox_2d": [171.0, 97.0, 188.0, 115.0], "label": "normal sperm"}, {"bbox_2d": [157.0, 166.0, 174.0, 184.0], "label": "normal sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "normal sperm"}, {"bbox_2d": [393.0, 281.0, 410.0, 299.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [534.0, 353.0, 551.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [546.0, 187.0, 562.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [409.0, 94.0, 426.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [480.0, 37.0, 497.0, 53.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [343.0, 264.0, 362.0, 280.0], "label": "normal sperm"}, {"bbox_2d": [294.0, 193.0, 311.0, 209.0], "label": "normal sperm"}, {"bbox_2d": [439.0, 226.0, 456.0, 244.0], "label": "normal sperm"}, {"bbox_2d": [606.0, 424.0, 621.0, 441.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [510.0, 40.0, 530.0, 56.0], "label": "normal sperm"}, {"bbox_2d": [302.0, 348.0, 329.0, 369.0], "label": "normal sperm"}, {"bbox_2d": [310.0, 9.0, 326.0, 22.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 13.0], "label": "normal sperm"}, {"bbox_2d": [224.0, 13.0, 239.0, 26.0], "label": "normal sperm"}]
```


[User] <image> How many sperm are there in the image?

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Find each normal sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [154.5, 410.5], [124.5, 406.0], [53.0, 387.0], [5.0, 375.0], [86.5, 90.5], [197.5, 119.0], [155.5, 76.0], [179.5, 106.0], [165.5, 175.0], [342.5, 468.0], [401.5, 290.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [542.5, 362.0], [530.0, 209.5], [554.0, 196.5], [417.5, 102.0], [488.5, 45.0], [454.5, 304.5], [352.5, 272.0], [302.5, 201.0], [447.5, 235.0], [613.5, 432.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [520.0, 48.0], [315.5, 358.5], [318.0, 15.5], [324.5, 8.0], [231.5, 19.5]], "label": "sperm"}
```


[User] <image> Provide the total number of normal sperm and for each, supply a bounding box.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [146.0, 401.0, 163.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 367.0, 10.0, 383.0], [78.0, 82.0, 95.0, 99.0], [189.0, 109.0, 206.0, 129.0], [147.0, 67.0, 164.0, 85.0], [171.0, 97.0, 188.0, 115.0], [157.0, 166.0, 174.0, 184.0], [334.0, 459.0, 351.0, 477.0], [393.0, 281.0, 410.0, 299.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [534.0, 353.0, 551.0, 371.0], [522.0, 200.0, 538.0, 219.0], [546.0, 187.0, 562.0, 206.0], [409.0, 94.0, 426.0, 110.0], [480.0, 37.0, 497.0, 53.0], [446.0, 296.0, 463.0, 313.0], [343.0, 264.0, 362.0, 280.0], [294.0, 193.0, 311.0, 209.0], [439.0, 226.0, 456.0, 244.0], [606.0, 424.0, 621.0, 441.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [510.0, 40.0, 530.0, 56.0], [302.0, 348.0, 329.0, 369.0], [310.0, 9.0, 326.0, 22.0], [315.0, 3.0, 334.0, 13.0], [224.0, 13.0, 239.0, 26.0]], "label": "sperm"}
```


[User] <image> Point: Where are the clusters?

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Outline the sperm cluster using a bounding box.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> count sperm cluster

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> Locate all sperm cluster in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Locate all instances of sperm cluster, count them, and return their bounding boxes.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> I am looking for normal sperms. Where can they be found in the image?

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [3.5, 380.5], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [200.5, 110.0], "label": "normal sperm"}, {"point_2d": [153.5, 79.0], "label": "normal sperm"}, {"point_2d": [177.5, 109.0], "label": "normal sperm"}, {"point_2d": [159.5, 177.0], "label": "normal sperm"}, {"point_2d": [342.5, 468.0], "label": "normal sperm"}, {"point_2d": [402.5, 291.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [541.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [412.5, 108.0], "label": "normal sperm"}, {"point_2d": [486.5, 48.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [345.5, 278.0], "label": "normal sperm"}, {"point_2d": [300.5, 204.0], "label": "normal sperm"}, {"point_2d": [487.5, 186.0], "label": "normal sperm"}, {"point_2d": [607.5, 445.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [314.5, 359.5], "label": "normal sperm"}, {"point_2d": [624.0, 188.5], "label": "normal sperm"}, {"point_2d": [313.0, 18.5], "label": "normal sperm"}, {"point_2d": [324.5, 8.5], "label": "normal sperm"}, {"point_2d": [230.5, 23.5], "label": "normal sperm"}]
```


[User] <image> Provide a bounding box that tightly encloses the sperm.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [0.0, 373.0, 7.0, 388.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [192.0, 100.0, 209.0, 120.0], "label": "sperm"}, {"bbox_2d": [145.0, 70.0, 162.0, 88.0], "label": "sperm"}, {"bbox_2d": [169.0, 100.0, 186.0, 118.0], "label": "sperm"}, {"bbox_2d": [151.0, 168.0, 168.0, 186.0], "label": "sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [533.0, 353.0, 550.0, 371.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [404.0, 100.0, 421.0, 116.0], "label": "sperm"}, {"bbox_2d": [478.0, 40.0, 495.0, 56.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [336.0, 270.0, 355.0, 286.0], "label": "sperm"}, {"bbox_2d": [292.0, 196.0, 309.0, 212.0], "label": "sperm"}, {"bbox_2d": [479.0, 177.0, 496.0, 195.0], "label": "sperm"}, {"bbox_2d": [600.0, 437.0, 615.0, 454.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "sperm"}, {"bbox_2d": [615.0, 178.0, 633.0, 199.0], "label": "sperm"}, {"bbox_2d": [305.0, 12.0, 321.0, 25.0], "label": "sperm"}, {"bbox_2d": [315.0, 2.0, 334.0, 15.0], "label": "sperm"}, {"bbox_2d": [223.0, 17.0, 238.0, 30.0], "label": "sperm"}]
```


[User] <image> count each sperm

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Show me each sperm by pointing at them, and then specify the total count.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 380.5], [86.5, 90.5], [200.5, 110.0], [153.5, 79.0], [177.5, 109.0], [159.5, 177.0], [342.5, 468.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [541.5, 362.0], [530.0, 209.5], [553.0, 196.5], [412.5, 108.0], [486.5, 48.0], [454.5, 304.5], [345.5, 278.0], [300.5, 204.0], [487.5, 186.0], [607.5, 445.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [624.0, 188.5], [313.0, 18.5], [324.5, 8.5], [230.5, 23.5]], "label": "sperm"}
```


[User] <image> Count the sperm and enclose each in a bounding box.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 373.0, 7.0, 388.0], [78.0, 82.0, 95.0, 99.0], [192.0, 100.0, 209.0, 120.0], [145.0, 70.0, 162.0, 88.0], [169.0, 100.0, 186.0, 118.0], [151.0, 168.0, 168.0, 186.0], [334.0, 459.0, 351.0, 477.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [533.0, 353.0, 550.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [404.0, 100.0, 421.0, 116.0], [478.0, 40.0, 495.0, 56.0], [446.0, 296.0, 463.0, 313.0], [336.0, 270.0, 355.0, 286.0], [292.0, 196.0, 309.0, 212.0], [479.0, 177.0, 496.0, 195.0], [600.0, 437.0, 615.0, 454.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [615.0, 178.0, 633.0, 199.0], [305.0, 12.0, 321.0, 25.0], [315.0, 2.0, 334.0, 15.0], [223.0, 17.0, 238.0, 30.0]], "label": "sperm"}
```


[User] <image> Locate every cluster.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Find the sperm cluster in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> how many sperm cluster?

[Assistant]
```json
{"count": 2, "label": "sperm cluster"}
```


[User] <image> How many cluster are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "sperm cluster"}
```


[User] <image> Count every cluster and return a list of bounding boxes.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "sperm cluster"}
```


[User] <image> Show me where the sperms are

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [3.5, 382.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [201.5, 109.0], "label": "sperm"}, {"point_2d": [153.5, 80.0], "label": "sperm"}, {"point_2d": [177.5, 109.0], "label": "sperm"}, {"point_2d": [158.5, 178.0], "label": "sperm"}, {"point_2d": [342.5, 468.0], "label": "sperm"}, {"point_2d": [402.5, 291.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [540.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [411.5, 109.0], "label": "sperm"}, {"point_2d": [486.5, 48.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [343.5, 280.0], "label": "sperm"}, {"point_2d": [299.5, 205.0], "label": "sperm"}, {"point_2d": [516.0, 195.0], "label": "sperm"}, {"point_2d": [606.5, 448.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [314.5, 359.5], "label": "sperm"}, {"point_2d": [621.0, 201.5], "label": "sperm"}, {"point_2d": [312.0, 19.5], "label": "sperm"}, {"point_2d": [324.5, 9.5], "label": "sperm"}, {"point_2d": [229.5, 24.5], "label": "sperm"}]
```


[User] <image> Mark the object sperm with a bounding box and return its coordinates.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [0.0, 374.0, 7.0, 390.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [193.0, 99.0, 210.0, 119.0], "label": "sperm"}, {"bbox_2d": [145.0, 71.0, 162.0, 89.0], "label": "sperm"}, {"bbox_2d": [169.0, 100.0, 186.0, 118.0], "label": "sperm"}, {"bbox_2d": [150.0, 169.0, 167.0, 187.0], "label": "sperm"}, {"bbox_2d": [334.0, 459.0, 351.0, 477.0], "label": "sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [532.0, 353.0, 549.0, 371.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [403.0, 101.0, 420.0, 117.0], "label": "sperm"}, {"bbox_2d": [478.0, 40.0, 495.0, 56.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [334.0, 272.0, 353.0, 288.0], "label": "sperm"}, {"bbox_2d": [291.0, 197.0, 308.0, 213.0], "label": "sperm"}, {"bbox_2d": [507.0, 186.0, 525.0, 204.0], "label": "sperm"}, {"bbox_2d": [599.0, 440.0, 614.0, 457.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "sperm"}, {"bbox_2d": [612.0, 191.0, 630.0, 212.0], "label": "sperm"}, {"bbox_2d": [304.0, 13.0, 320.0, 26.0], "label": "sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 16.0], "label": "sperm"}, {"bbox_2d": [222.0, 18.0, 237.0, 31.0], "label": "sperm"}]
```


[User] <image> How many normal sperm are there?

[Assistant]
```json
{"count": 34, "label": "normal sperm"}
```


[User] <image> Count every sperm in the picture, then point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 382.0], [86.5, 90.5], [201.5, 109.0], [153.5, 80.0], [177.5, 109.0], [158.5, 178.0], [342.5, 468.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [540.5, 362.0], [530.0, 209.5], [553.0, 196.5], [411.5, 109.0], [486.5, 48.0], [454.5, 304.5], [343.5, 280.0], [299.5, 205.0], [516.0, 195.0], [606.5, 448.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [621.0, 201.5], [312.0, 19.5], [324.5, 9.5], [229.5, 24.5]], "label": "normal sperm"}
```


[User] <image> Draw bounding boxes around every sperm and then provide the total count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 374.0, 7.0, 390.0], [78.0, 82.0, 95.0, 99.0], [193.0, 99.0, 210.0, 119.0], [145.0, 71.0, 162.0, 89.0], [169.0, 100.0, 186.0, 118.0], [150.0, 169.0, 167.0, 187.0], [334.0, 459.0, 351.0, 477.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [532.0, 353.0, 549.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [403.0, 101.0, 420.0, 117.0], [478.0, 40.0, 495.0, 56.0], [446.0, 296.0, 463.0, 313.0], [334.0, 272.0, 353.0, 288.0], [291.0, 197.0, 308.0, 213.0], [507.0, 186.0, 525.0, 204.0], [599.0, 440.0, 614.0, 457.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [612.0, 191.0, 630.0, 212.0], [304.0, 13.0, 320.0, 26.0], [315.0, 3.0, 334.0, 16.0], [222.0, 18.0, 237.0, 31.0]], "label": "normal sperm"}
```


[User] <image> Point to a cluster

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Specify the bounding box for the sperm cluster in the image.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "sperm cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "sperm cluster"}]
```


[User] <image> Give me the count of cluster in the image.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Point to each instance of cluster and then output their total number.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Outline all instances of cluster with bounding boxes, then return the count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Point out each sperm in the image.

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "sperm"}, {"point_2d": [152.5, 276.5], "label": "sperm"}, {"point_2d": [153.5, 410.5], "label": "sperm"}, {"point_2d": [124.5, 406.0], "label": "sperm"}, {"point_2d": [53.0, 387.0], "label": "sperm"}, {"point_2d": [3.5, 383.0], "label": "sperm"}, {"point_2d": [86.5, 90.5], "label": "sperm"}, {"point_2d": [202.5, 108.0], "label": "sperm"}, {"point_2d": [153.5, 81.0], "label": "sperm"}, {"point_2d": [176.5, 110.0], "label": "sperm"}, {"point_2d": [157.5, 178.0], "label": "sperm"}, {"point_2d": [343.5, 469.0], "label": "sperm"}, {"point_2d": [402.5, 291.0], "label": "sperm"}, {"point_2d": [312.5, 417.0], "label": "sperm"}, {"point_2d": [539.5, 410.5], "label": "sperm"}, {"point_2d": [533.5, 470.5], "label": "sperm"}, {"point_2d": [540.5, 362.0], "label": "sperm"}, {"point_2d": [530.0, 209.5], "label": "sperm"}, {"point_2d": [553.0, 196.5], "label": "sperm"}, {"point_2d": [410.5, 111.0], "label": "sperm"}, {"point_2d": [485.5, 49.0], "label": "sperm"}, {"point_2d": [454.5, 304.5], "label": "sperm"}, {"point_2d": [341.5, 281.0], "label": "sperm"}, {"point_2d": [298.5, 206.0], "label": "sperm"}, {"point_2d": [524.0, 199.0], "label": "sperm"}, {"point_2d": [604.5, 451.5], "label": "sperm"}, {"point_2d": [376.0, 57.0], "label": "sperm"}, {"point_2d": [385.0, 99.0], "label": "sperm"}, {"point_2d": [548.0, 107.5], "label": "sperm"}, {"point_2d": [314.5, 359.5], "label": "sperm"}, {"point_2d": [605.0, 212.5], "label": "sperm"}, {"point_2d": [311.0, 20.5], "label": "sperm"}, {"point_2d": [324.5, 9.5], "label": "sperm"}, {"point_2d": [229.5, 25.5], "label": "sperm"}]
```


[User] <image> Outline the sperm using a bounding box.

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "sperm"}, {"bbox_2d": [0.0, 375.0, 7.0, 391.0], "label": "sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "sperm"}, {"bbox_2d": [194.0, 98.0, 211.0, 118.0], "label": "sperm"}, {"bbox_2d": [145.0, 72.0, 162.0, 90.0], "label": "sperm"}, {"bbox_2d": [168.0, 101.0, 185.0, 119.0], "label": "sperm"}, {"bbox_2d": [149.0, 169.0, 166.0, 187.0], "label": "sperm"}, {"bbox_2d": [335.0, 460.0, 352.0, 478.0], "label": "sperm"}, {"bbox_2d": [394.0, 282.0, 411.0, 300.0], "label": "sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "sperm"}, {"bbox_2d": [532.0, 353.0, 549.0, 371.0], "label": "sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "sperm"}, {"bbox_2d": [402.0, 103.0, 419.0, 119.0], "label": "sperm"}, {"bbox_2d": [477.0, 41.0, 494.0, 57.0], "label": "sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "sperm"}, {"bbox_2d": [332.0, 273.0, 351.0, 289.0], "label": "sperm"}, {"bbox_2d": [290.0, 198.0, 307.0, 214.0], "label": "sperm"}, {"bbox_2d": [515.0, 190.0, 533.0, 208.0], "label": "sperm"}, {"bbox_2d": [597.0, 443.0, 612.0, 460.0], "label": "sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "sperm"}, {"bbox_2d": [301.0, 349.0, 328.0, 370.0], "label": "sperm"}, {"bbox_2d": [596.0, 202.0, 614.0, 223.0], "label": "sperm"}, {"bbox_2d": [303.0, 14.0, 319.0, 27.0], "label": "sperm"}, {"bbox_2d": [315.0, 2.0, 334.0, 17.0], "label": "sperm"}, {"bbox_2d": [222.0, 19.0, 237.0, 32.0], "label": "sperm"}]
```


[User] <image> count sperm.

[Assistant]
```json
{"count": 34, "label": "sperm"}
```


[User] <image> Find each sperm. How many are there? Point to them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 383.0], [86.5, 90.5], [202.5, 108.0], [153.5, 81.0], [176.5, 110.0], [157.5, 178.0], [343.5, 469.0], [402.5, 291.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [540.5, 362.0], [530.0, 209.5], [553.0, 196.5], [410.5, 111.0], [485.5, 49.0], [454.5, 304.5], [341.5, 281.0], [298.5, 206.0], [524.0, 199.0], [604.5, 451.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [314.5, 359.5], [605.0, 212.5], [311.0, 20.5], [324.5, 9.5], [229.5, 25.5]], "label": "sperm"}
```


[User] <image> Find all sperm in the image, output the count and their bounding boxes.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 375.0, 7.0, 391.0], [78.0, 82.0, 95.0, 99.0], [194.0, 98.0, 211.0, 118.0], [145.0, 72.0, 162.0, 90.0], [168.0, 101.0, 185.0, 119.0], [149.0, 169.0, 166.0, 187.0], [335.0, 460.0, 352.0, 478.0], [394.0, 282.0, 411.0, 300.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [532.0, 353.0, 549.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [402.0, 103.0, 419.0, 119.0], [477.0, 41.0, 494.0, 57.0], [446.0, 296.0, 463.0, 313.0], [332.0, 273.0, 351.0, 289.0], [290.0, 198.0, 307.0, 214.0], [515.0, 190.0, 533.0, 208.0], [597.0, 443.0, 612.0, 460.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [301.0, 349.0, 328.0, 370.0], [596.0, 202.0, 614.0, 223.0], [303.0, 14.0, 319.0, 27.0], [315.0, 2.0, 334.0, 17.0], [222.0, 19.0, 237.0, 32.0]], "label": "sperm"}
```


[User] <image> Locate the cluster.

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "cluster"}, {"point_2d": [205.0, 101.0], "label": "cluster"}]
```


[User] <image> Identify cluster and output its bounding box in [xx, yy, xx, yy] format.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Find each cluster. How many are there?

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Indicate each cluster in the image with a point and then return the overall count.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Provide bounding box coordinates for each cluster and then specify the total count.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```


[User] <image> Point to all occurrences of "normal sperms"

[Assistant]
```json
[{"point_2d": [169.0, 209.0], "label": "normal sperm"}, {"point_2d": [152.5, 276.5], "label": "normal sperm"}, {"point_2d": [153.5, 410.5], "label": "normal sperm"}, {"point_2d": [124.5, 406.0], "label": "normal sperm"}, {"point_2d": [53.0, 387.0], "label": "normal sperm"}, {"point_2d": [3.5, 385.0], "label": "normal sperm"}, {"point_2d": [86.5, 90.5], "label": "normal sperm"}, {"point_2d": [202.5, 108.0], "label": "normal sperm"}, {"point_2d": [152.5, 82.0], "label": "normal sperm"}, {"point_2d": [175.5, 112.0], "label": "normal sperm"}, {"point_2d": [155.5, 179.0], "label": "normal sperm"}, {"point_2d": [343.5, 469.0], "label": "normal sperm"}, {"point_2d": [402.5, 292.0], "label": "normal sperm"}, {"point_2d": [312.5, 417.0], "label": "normal sperm"}, {"point_2d": [539.5, 410.5], "label": "normal sperm"}, {"point_2d": [533.5, 470.5], "label": "normal sperm"}, {"point_2d": [539.5, 362.0], "label": "normal sperm"}, {"point_2d": [530.0, 209.5], "label": "normal sperm"}, {"point_2d": [553.0, 196.5], "label": "normal sperm"}, {"point_2d": [408.5, 111.0], "label": "normal sperm"}, {"point_2d": [485.5, 49.0], "label": "normal sperm"}, {"point_2d": [454.5, 304.5], "label": "normal sperm"}, {"point_2d": [338.5, 283.0], "label": "normal sperm"}, {"point_2d": [297.5, 207.0], "label": "normal sperm"}, {"point_2d": [553.0, 180.0], "label": "normal sperm"}, {"point_2d": [602.5, 454.5], "label": "normal sperm"}, {"point_2d": [376.0, 57.0], "label": "normal sperm"}, {"point_2d": [385.0, 99.0], "label": "normal sperm"}, {"point_2d": [548.0, 107.5], "label": "normal sperm"}, {"point_2d": [313.5, 360.5], "label": "normal sperm"}, {"point_2d": [602.5, 241.0], "label": "normal sperm"}, {"point_2d": [310.0, 21.5], "label": "normal sperm"}, {"point_2d": [324.5, 10.5], "label": "normal sperm"}, {"point_2d": [229.5, 26.5], "label": "normal sperm"}]
```


[User] <image> Enclose normal sperm in a bounding box. Format: [xx, yy, xx, yy].

[Assistant]
```json
[{"bbox_2d": [160.0, 200.0, 178.0, 218.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 267.0, 161.0, 286.0], "label": "normal sperm"}, {"bbox_2d": [145.0, 401.0, 162.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [116.0, 397.0, 133.0, 415.0], "label": "normal sperm"}, {"bbox_2d": [45.0, 378.0, 61.0, 396.0], "label": "normal sperm"}, {"bbox_2d": [0.0, 377.0, 7.0, 393.0], "label": "normal sperm"}, {"bbox_2d": [78.0, 82.0, 95.0, 99.0], "label": "normal sperm"}, {"bbox_2d": [194.0, 98.0, 211.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [144.0, 73.0, 161.0, 91.0], "label": "normal sperm"}, {"bbox_2d": [167.0, 103.0, 184.0, 121.0], "label": "normal sperm"}, {"bbox_2d": [147.0, 170.0, 164.0, 188.0], "label": "normal sperm"}, {"bbox_2d": [335.0, 460.0, 352.0, 478.0], "label": "normal sperm"}, {"bbox_2d": [394.0, 283.0, 411.0, 301.0], "label": "normal sperm"}, {"bbox_2d": [304.0, 408.0, 321.0, 426.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 401.0, 548.0, 420.0], "label": "normal sperm"}, {"bbox_2d": [525.0, 461.0, 542.0, 480.0], "label": "normal sperm"}, {"bbox_2d": [531.0, 353.0, 548.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [522.0, 200.0, 538.0, 219.0], "label": "normal sperm"}, {"bbox_2d": [545.0, 187.0, 561.0, 206.0], "label": "normal sperm"}, {"bbox_2d": [400.0, 103.0, 417.0, 119.0], "label": "normal sperm"}, {"bbox_2d": [477.0, 41.0, 494.0, 57.0], "label": "normal sperm"}, {"bbox_2d": [446.0, 296.0, 463.0, 313.0], "label": "normal sperm"}, {"bbox_2d": [329.0, 275.0, 348.0, 291.0], "label": "normal sperm"}, {"bbox_2d": [289.0, 199.0, 306.0, 215.0], "label": "normal sperm"}, {"bbox_2d": [544.0, 171.0, 562.0, 189.0], "label": "normal sperm"}, {"bbox_2d": [595.0, 446.0, 610.0, 463.0], "label": "normal sperm"}, {"bbox_2d": [366.0, 45.0, 386.0, 69.0], "label": "normal sperm"}, {"bbox_2d": [377.0, 88.0, 393.0, 110.0], "label": "normal sperm"}, {"bbox_2d": [536.0, 97.0, 560.0, 118.0], "label": "normal sperm"}, {"bbox_2d": [300.0, 350.0, 327.0, 371.0], "label": "normal sperm"}, {"bbox_2d": [594.0, 232.0, 611.0, 250.0], "label": "normal sperm"}, {"bbox_2d": [302.0, 15.0, 318.0, 28.0], "label": "normal sperm"}, {"bbox_2d": [315.0, 3.0, 334.0, 18.0], "label": "normal sperm"}, {"bbox_2d": [222.0, 20.0, 237.0, 33.0], "label": "normal sperm"}]
```


[User] <image> Locate all sperm in the image by pointing to them and then counting them.

[Assistant]
```json
{"count": 34, "point_2d": [[169.0, 209.0], [152.5, 276.5], [153.5, 410.5], [124.5, 406.0], [53.0, 387.0], [3.5, 385.0], [86.5, 90.5], [202.5, 108.0], [152.5, 82.0], [175.5, 112.0], [155.5, 179.0], [343.5, 469.0], [402.5, 292.0], [312.5, 417.0], [539.5, 410.5], [533.5, 470.5], [539.5, 362.0], [530.0, 209.5], [553.0, 196.5], [408.5, 111.0], [485.5, 49.0], [454.5, 304.5], [338.5, 283.0], [297.5, 207.0], [553.0, 180.0], [602.5, 454.5], [376.0, 57.0], [385.0, 99.0], [548.0, 107.5], [313.5, 360.5], [602.5, 241.0], [310.0, 21.5], [324.5, 10.5], [229.5, 26.5]], "label": "sperm"}
```


[User] <image> Return bounding boxes for each sperm in the image and the total count.

[Assistant]
```json
{"count": 34, "bbox_2d": [[160.0, 200.0, 178.0, 218.0], [144.0, 267.0, 161.0, 286.0], [145.0, 401.0, 162.0, 420.0], [116.0, 397.0, 133.0, 415.0], [45.0, 378.0, 61.0, 396.0], [0.0, 377.0, 7.0, 393.0], [78.0, 82.0, 95.0, 99.0], [194.0, 98.0, 211.0, 118.0], [144.0, 73.0, 161.0, 91.0], [167.0, 103.0, 184.0, 121.0], [147.0, 170.0, 164.0, 188.0], [335.0, 460.0, 352.0, 478.0], [394.0, 283.0, 411.0, 301.0], [304.0, 408.0, 321.0, 426.0], [531.0, 401.0, 548.0, 420.0], [525.0, 461.0, 542.0, 480.0], [531.0, 353.0, 548.0, 371.0], [522.0, 200.0, 538.0, 219.0], [545.0, 187.0, 561.0, 206.0], [400.0, 103.0, 417.0, 119.0], [477.0, 41.0, 494.0, 57.0], [446.0, 296.0, 463.0, 313.0], [329.0, 275.0, 348.0, 291.0], [289.0, 199.0, 306.0, 215.0], [544.0, 171.0, 562.0, 189.0], [595.0, 446.0, 610.0, 463.0], [366.0, 45.0, 386.0, 69.0], [377.0, 88.0, 393.0, 110.0], [536.0, 97.0, 560.0, 118.0], [300.0, 350.0, 327.0, 371.0], [594.0, 232.0, 611.0, 250.0], [302.0, 15.0, 318.0, 28.0], [315.0, 3.0, 334.0, 18.0], [222.0, 20.0, 237.0, 33.0]], "label": "sperm"}
```


[User] <image> Find any sperm clusters

[Assistant]
```json
[{"point_2d": [365.0, 64.0], "label": "sperm cluster"}, {"point_2d": [205.0, 101.0], "label": "sperm cluster"}]
```


[User] <image> Find the cluster in the image and output a bounding box around it.

[Assistant]
```json
[{"bbox_2d": [336.0, 37.0, 394.0, 91.0], "label": "cluster"}, {"bbox_2d": [172.0, 78.0, 238.0, 124.0], "label": "cluster"}]
```


[User] <image> Tell me where each cluster is.

[Assistant]
```json
{"count": 2, "label": "cluster"}
```


[User] <image> Find each sperm cluster. How many are there? Point to them.

[Assistant]
```json
{"count": 2, "point_2d": [[365.0, 64.0], [205.0, 101.0]], "label": "cluster"}
```


[User] <image> Provide the total number of sperm cluster and for each, supply a bounding box.

[Assistant]
```json
{"count": 2, "bbox_2d": [[336.0, 37.0, 394.0, 91.0], [172.0, 78.0, 238.0, 124.0]], "label": "cluster"}
```