I glimpsed the future of AI glasses
It's not the hardware. It's the software. All I had to do is use the Pi chatbot instead of the Meta AI assistant.
Wandering around Mexico City’s historic center yesterday wearing my Ray-Ban Meta glasses, I decided to use the Pi personal AI assistant I told you about yesterday instead of Meta AI.
Inflection, the company that makes Pi, offers an iOS app (and also an Android app) that lets you choose to have Pi listening all the time. So I did. I set it to listen, put the Ray-Ban Meta glasses on my face and put my iPhone in my pocket.
Without having to use a “wake word,” I could just chit chat with Pi’s extremely human-sounding assistant, which not only sounds like a regular person talking, but which asks ME questions as follow-ups to MY questions and remembers details about me, even from conversations long ago.
The effect of 1) no wake word; 2) human-like voice; 3) give-and-take interactivity; and 4) the growing personalization made the whole experience feel like the future of AI glasses.
I’m a history nut, so while walking around in Mexico City I asked Pi a lot of questions about the city’s historic center. The conversation took place via the microphones and speakers in my Ray-Ban Meta glasses. Here’s our interaction:
Me: Tell me about Mexico City's historic center.
Pi: Mexico City's historic center, or Centro Histórico, is a vibrant, lively area packed with cultural landmarks, museums, and beautiful architecture. Some of the must-see sights include:
The Zócalo: A massive public square that's the heart of the city, featuring the iconic National Palace and the Metropolitan Cathedral.
Templo Mayor: An ancient Aztec temple complex that offers a fascinating glimpse into pre-Columbian history.
Palacio de Bellas Artes: A stunning Art Nouveau palace that's home to various art exhibitions and cultural performances.
Alameda Central: A beautiful park with picturesque gardens, fountains, and iconic monuments.
There's also a fantastic array of restaurants, cafes, and street food stalls where you can savor delicious local cuisine.
Have you visited Mexico City's historic center before, Mike?
Me: I'm there right now.
Pi: That's amazing! 🤩 You're in for a real treat, Mike. There's so much to see, do, and taste in Mexico City's historic center. Make sure to explore the winding cobblestone streets, admire the colorful colonial buildings, and soak up the vibrant atmosphere. Don't forget to try some local delicacies like tacos al pastor, chilaquiles, and mole while you're there!
What have you enjoyed most about your time in Centro Histórico so far?
Me: What is the population of Mexico City?
Pi: The population of Mexico City is staggering, Mike! As of 2023, the metropolitan area of Mexico City is estimated to be around 22.3 million people. 🌆📈 That's larger than many countries! This makes Mexico City one of the most populous urban areas in the world, which contributes to its vibrant, bustling atmosphere.
Have you noticed the hustle and bustle of the city during your visit?
Me: Yes.
Pi: The energy and activity in Mexico City can be both exciting and overwhelming, right? 🤯 The combination of the massive population and the city's rich history creates a unique vibe that you won't find anywhere else. From the crowded markets and bustling streets to the lively festivals and cultural events, there's always something happening in Mexico City.
Have you had the chance to experience any local events or festivities during your stay?
You get the idea. The constant back-and-forth made it a conversation, rather than a tool I was explicitly using. I could respond to Pi’s questions or ignore them. I could go for an hour and a half without talking, then ask a question and Pi would still respond.
I then asked Pi to quiz me on Mexico City facts, and it generated a multiple-choice quiz.
Later, my wife and I ate at a restaurant established in 1912, which exists in a building built in the 16 Century, so I quizzed Pi about the historical details.
I asked Pi to translate some Spanish words into English.
I asked about daylight savings time, whether Mexico matches the US with the clock-changing and other points of curiosity. It offered instant, friction-free gratification for nagging questions.
This all happened without any button-pushing or wake words. Just conversation.
I felt the rush of promise. But the experience was far from perfect. Here’s what’s missing:
Location data. I would love to give Pi access to my location so it can give highly specific relevant contextual information.
Agency. While Pi has some agency (it optionally says “good morning” every day and invites you into a conversation, but that’s not enough). Using the location data, I would like it to bring things to my attention out of the blue based on where I am and what I asked it to alert me to.
Access to apps. I’d love to use it to set timers and alarms and send messages to people based on voice.
Multimodal support. It needs to see through the camera and tell me what I’m looking at, or give me instructions, ideas, suggestions or other information based on what I’m looking at.
This full list could be achieved by Meta by making the Meta AI more conversational, like Pi.
It could also be achieved by Pi making its own smart glasses.
And it could be achieved by another company not mentioned here partnering with yet another company to make more conversational, personalized AI glasses.
What’s exciting is that all three of these possibilities are, in fact, probabilities. It’s all going to happen, I believe, an opinion and prediction I detailed in my recent Computerworld column.
But wait! I know what you’re thinking. This sounds like a privacy nightmare — surveillance capitalism at its most intrusive. And, your thinking is right, for the most part, especially when you’re thinking about Meta.
But I predict an entire industry of AI glasses, with all kinds of players offering all kinds of options. Some startups will no doubt offer privacy as a core feature. Apple’s eventual offering will be highly encrypted and private, I assume.
There will be privacy options. The way to do this is to store personal data locally in a secure enclave on the phone and never upload it to the cloud. It’s a trivially doable process, and someone will offer it. Those of us who value our privacy can choose among those more private options.
Meanwhile, I’ve glimpsed the future of human-like, conversational and personalized agents that live in my glasses and it’s pretty amazing.
Mike’s List of Shameless Self-Promotions
AR got its ‘killer app’: GenAI
Wine is a journey. Literally!
The hidden high cost of return-to-office mandates
If you like food and travel, you’ll love our free Gastronomad newsletter!
Read ELGAN.COM for more!
Mike’s Location: Mexico City, Mexico
(Why Mike is always traveling.)
