Mark III Systems Blog

Does Microsoft Word use Deep Learning?

Before there was deep learning, there was Clippy

A few days ago, I was writing a document in Microsoft Word and found something very interesting. I inserted a picture and noticed it automatically created a caption for the image. I was really impressed. Image captioning is not an easy process. You have to combine convolutional neural networks (CNNs) with recurrent neural networks (RNNs), particularly Long Short Term Memory (LSTMs) RNNs. Putting those models in production in the standard word processing program is a great example of artificial intelligence in our every day work and how AI is being integrated into all parts of our lives.

The image above is a Workflow for Image Captioning. Input the image, use CNN to get feature vector, then use feature vector as input for the LSTM. (Image Source here)

Click here to watch my demo on YouTube!

If you have questions and want to connect, you can message me on LinkedIn or Twitter.