Google AI Vision

By Albert Su
Date: February 7, 2018

Google Vision AI was used to analyze two pictures of dogs. The Request Body of the image was posted to the AI using JSON embedded into the browser while the AI Response responded with the type of animal and description of the background.

Request Body

{
“requests”: [
{
“features”: [
{
“type”: “LABEL_DETECTION”
}
],
“image”: {
“source”: {
“imageUri”: “gs://bucket-name-123/demo-image.jpg”
}
}
}
]
}


AI Response

{
“responses”: [
{
“labelAnnotations”: [
{
“mid”: “/m/0bt9lr”,
“description”: “dog”,
“score”: 0.8920207,
“topicality”: 0.8920207
},
{
“mid”: “/m/01z5f”,
“description”: “dog like mammal”,
“score”: 0.88694125,
“topicality”: 0.88694125
},
{
“mid”: “/m/08t9c_”,
“description”: “grass”,
“score”: 0.8723395,
“topicality”: 0.8723395
},
{
“mid”: “/m/0kpmf”,
“description”: “dog breed”,
“score”: 0.86987364,
“topicality”: 0.86987364
},
{
“mid”: “/m/01c7cq”,
“description”: “grassland”,
“score”: 0.72486955,
“topicality”: 0.72486955
},
{
“mid”: “/m/025st_8”,
“description”: “meadow”,
“score”: 0.6538264,
“topicality”: 0.6538264
},
{
“mid”: “/m/05mqq3”,
“description”: “snout”,
“score”: 0.6483445,
“topicality”: 0.6483445
},
{
“mid”: “/m/02wbgd”,
“description”: “english cocker spaniel”,
“score”: 0.6269685,
“topicality”: 0.6269685
},
{
“mid”: “/m/02kysw”,
“description”: “spaniel”,
“score”: 0.62650734,
“topicality”: 0.62650734
},
{
“mid”: “/m/01gd91”,
“description”: “pasture”,
“score”: 0.62508965,
“topicality”: 0.62508965
}
]
}
]
}

Request Body

{
“requests”: [
{
“features”: [
{
“type”: “LABEL_DETECTION”
}
],
“image”: {
“source”: {
“imageUri”: “gs://bucketalice/IMG_3881.jpg”
}
}
}
]
}


AI Response

{
“responses”: [
{
“labelAnnotations”: [
{
“mid”: “/m/01z5f”,
“description”: “dog like mammal”,
“score”: 0.8726515,
“topicality”: 0.8726515
},
{
“mid”: “/m/0kpmf”,
“description”: “dog breed”,
“score”: 0.8633622,
“topicality”: 0.8633622
},
{
“mid”: “/m/035qhg”,
“description”: “fauna”,
“score”: 0.8626649,
“topicality”: 0.8626649
},
{
“mid”: “/m/0bt9lr”,
“description”: “dog”,
“score”: 0.8539165,
“topicality”: 0.8539165
},
{
“mid”: “/m/02xl47d”,
“description”: “dog breed group”,
“score”: 0.79741335,
“topicality”: 0.79741335
},
{
“mid”: “/m/05zmzn1”,
“description”: “street dog”,
“score”: 0.7951209,
“topicality”: 0.7951209
},
{
“mid”: “/m/02gxqz”,
“description”: “hunting dog”,
“score”: 0.5730597,
“topicality”: 0.5730597
},
{
“mid”: “/m/0hm03”,
“description”: “trail”,
“score”: 0.5147512,
“topicality”: 0.5147512
}
]
}
]
}

References

https://cloud.google.com/vision/docs/request

https://cloud.google.com/vision/docs/quickstart