We're explore ideas of more AI integrations within Spatial, through the use of external APIs like the OpenAI API. If this was enabled, how would you use AI in your games and experiences?
You can now apply to get Beta access to use Unity Web Requests in your Creator Toolkit experiences, which would allow you, among other things, to use the OpenAI API/ChatGPT in your experiences.
I feel meh about AI but there are tens if not hundreds of external APIs my Unity dev team could use to cool effect in Spatial that we would love to have access to. Let’s just have them all. If safety is a hindering concern then let’s prioritize better moderation of spaces and players.
spatial
Team•
May 16, 2024
What external APIs are you interested in using?
Laurie Annis
•
May 16, 2024
I would just like to have access to Unity's web request, which would open up a million useful APIs, like for a project I was working on to bring historical content into a game from the Library of Congress or Ancestry.com
I also had an idea to make a cozy game like The Longing where you can read books through Project Gutenberg, or to bring in data from my own website Interconnect3d.com to display dynamic analytics in an interactive way.
The list is as infinite as the web. I'd even just like to create custom API's to store my users' high scores and such.
spatial
Team•
May 30, 2024
We'll be testing API/web request access soon with a group of testers - we'll reach out!
Hello! I love using Spatial.io with my students. I have been using OpenAI API Keys for NPC bots in SL and would be keen on seeing the same feature in Spatial.io too, preferably with avatar voice.
Thank you for giving me this opportunity to communicate here.
Kind regards,
Helena
G
•
May 16, 2024
A wide variety of useful game dev or connectivity APIs in general? Yes excellent, do it.
Just the AI flavour of the day so you can suck another round of funding from investors? Not really interested.
You guys have a MASSIVE problem with focused development and delivering a reliable product.
Stop chasing the new hype of the year (youve gone from VR to VR for work, web 3.0, NFTs, metaverse, mobile gaming, creator economy and now AI) and focus on delivering key features on ANY one of those numerous existing fronts before opening yet another!
AI is really cool, but I'll eat my hat if anyone ever builds anything actually impressive in Spatial with it because you can't be trusted to support it long enough for any real users to get up to speed with it before youll effectively abandon it to run off chasing the next shiny new tech thing.
I've seen toddlers with better long term focus and planning. Wheres the vision? Wheres your roadmap for the next year of features? Why do you want to add AI support? How is it going to integrate with your existing services? What business use cases does it support? Will it be used and is it affordable for end user's as prices increase? What other features will you have to drop from planning to develop it?
Im sorry but this is almost farcical.
Laurie Annis
•
May 16, 2024
I love Spatial and the promise of instant infrastructure onto which I can build my games and have multiplayer and streaming out of the box using Unity a game engine I know and love, but for that Spatial to survive, decision makers are going to have to take advice like this seriously. Agree 1000%
spatial
Team•
May 16, 2024
We appreciate that feedback! What features do you think we should focus us that would have the biggest impact?
Laurie Annis
•
May 16, 2024
I think getting the whole Spatial team to pay attention to the massive user community you have cultivated on Discord would be the best first step. I can't speak for everyone there, but it often seems to me as though feedback is asked for by one or two Spatial devs and then never followed up on. It's almost as if we don't exist at times.
Toward that end, tap into the talent of your many game developer users like me and the person above who are active on Discord, champing at the bit to bring our communities to the platform but are floundering without adequate support.
Furthermore, I would love to see the long-ago promise fulfilled of Spatial's internal games (like Punch Hero) being opened up for us community members to learn from and pick apart and use as templates. Instead of Spatial attempting to develop the next blockbuster game internally, let us use those internal games to empower your User Generated Content creators with the tools to build their OWN viral games *edited to add and monetize our own games, the way that Roblox does.
Rob Keanalley
•
May 16, 2024
Would be amazing to be able to incorporate chat bot NPCs on specific topics to enhance educational spaces.
PinkCryptoBabe
•
May 16, 2024
Would love to be able to integrate that feature in my spaces
spatial
Team•
May 16, 2024
How specifically would you use AI i your spaces?
PinkCryptoBabe
•
May 16, 2024
Make the Virtual Avatar Daisy from my spaces interact.
spatial
Team•
May 16, 2024
Meaning you could have a conversation with your virtual avatar?
PinkCryptoBabe
•
May 16, 2024
Yes, this my idea from maybe 8 months ago, there are integration which could work in spatial. If you want dm on discord i can send youa link. Kind regards
PinkCryptoBabe
•
May 16, 2024
It is a behavior trained npc, what i mean..... sorry for the misunderstanding
Joel Miles-Board
•
May 16, 2024
We have built digital twins for businesses and many ask for this feature to allow visitors to their space to ask questions and have the bot answer them. One client we had to swap from spatial to Mesh just because they needed this feature and Mesh allows api calls. So yes, this would very much be a feature we'd like to see.
G
•
May 16, 2024
I have honestly been trying for years to confirm that Mesh actually exists and isn't vaporware. Have you actually tried it? Like hands on, headset on face tried it?
G
•
May 16, 2024
Why would I join a corporate space to ask questions of a bot though? The major benefit of a Space is the interaction with either multiple ppl or the world itself? Like ive heard ppl making spaces that you join to fill in a form... but why?
I can see plenty of uses for AI in gaming / world creation and I can see examples of using AI to manage customers. But combining both feels like a "because we can" product unless the AI and Space has a clear interaction and use to each other and and both have meaning to the user.
An AI that can help me and a teammate debug a Quest in spatial or create images / notes of a meeting we have in spatial or live translate our languages (cough cough if it worked cough) would be amazing.
One that I could simply interact with on a store page though doesnt benefit from the 3d environment much at all? Unless the company literally doesn't have a website and ONLY has a Spatial space in which case it still doesn't benefit but is at least potentially needed.
Mike Cerqua (MetaMike)
•
May 16, 2024
Id love to see AI avartar agents where anyone can build the AI personality easily without any tech or unity background using Inworld.ai or convai.com. They can create their AI persona themselves then give the url/sku (or whatever they use to reference the account) to someone who might be more comfortable using unity to connect the 3d avtar to the AI persona and give it to the as a spatial unity prefab.
Frank Michael
•
May 17, 2024
To enhance our Wealth Conglomerate Virtual Arena, we propose integrating the API by OpenAI. This will allow users to interact with AI-powered NPC guides for real-time assistance, engage in adaptive AI-driven quests, and access AI-aided design tools. Additionally, users can learn about specific topics or sectors connected with the Wealth Conglomerate by communicating with tailored AI. These features will elevate our arena into a 24/7 educational and interactive space, enriching user experiences through the Spatial Creator Toolkit.
Laurie Annis
•
May 17, 2024
AI avatars (chat bots) are neato, but they're not going to make any Spatial space go viral.
Linexperts Metaverso
•
May 20, 2024
In the case of my team we want to improve the user experience through the spaces with a virtual assistant which has the ability to listen to users, interpret what they say with chatgpt, and then respond by voice again, to solve space and general doubts of the company using the power of an AI like Chatgpt, Whisper or TTS.
Log in to comment and vote
Comments31
spatial
Jul 8, 2024
PinnedYou can now apply to get Beta access to use Unity Web Requests in your Creator Toolkit experiences, which would allow you, among other things, to use the OpenAI API/ChatGPT in your experiences.
Fill out this form to request access: https://forms.gle/TMi2J72d2P9AS6dD6
Here’s a demo experience showing ChatGPT in action in a Spatial space: https://www.spatial.io/s/Deep-Thought-ChatGPT-Demo-6668cd51df01889bcded2f24?share=1408035684932557691
Laurie Annis
May 16, 2024
I feel meh about AI but there are tens if not hundreds of external APIs my Unity dev team could use to cool effect in Spatial that we would love to have access to. Let’s just have them all. If safety is a hindering concern then let’s prioritize better moderation of spaces and players.
spatial
May 16, 2024
What external APIs are you interested in using?
Laurie Annis
May 16, 2024
I would just like to have access to Unity's web request, which would open up a million useful APIs, like for a project I was working on to bring historical content into a game from the Library of Congress or Ancestry.com
I also had an idea to make a cozy game like The Longing where you can read books through Project Gutenberg, or to bring in data from my own website Interconnect3d.com to display dynamic analytics in an interactive way.
The list is as infinite as the web. I'd even just like to create custom API's to store my users' high scores and such.
spatial
May 30, 2024
We'll be testing API/web request access soon with a group of testers - we'll reach out!
Laurie Annis
May 17, 2024
Here's another https://www.youtube.com/watch?v=BPCuT_5Hv8U
(Geospatial content in Google Maps)
Helena Galani
Aug 9, 2024
Hello! I love using Spatial.io with my students. I have been using OpenAI API Keys for NPC bots in SL and would be keen on seeing the same feature in Spatial.io too, preferably with avatar voice.
Thank you for giving me this opportunity to communicate here.
Kind regards,
Helena
G
May 16, 2024
A wide variety of useful game dev or connectivity APIs in general? Yes excellent, do it.
Just the AI flavour of the day so you can suck another round of funding from investors? Not really interested.
You guys have a MASSIVE problem with focused development and delivering a reliable product.
Stop chasing the new hype of the year (youve gone from VR to VR for work, web 3.0, NFTs, metaverse, mobile gaming, creator economy and now AI) and focus on delivering key features on ANY one of those numerous existing fronts before opening yet another!
AI is really cool, but I'll eat my hat if anyone ever builds anything actually impressive in Spatial with it because you can't be trusted to support it long enough for any real users to get up to speed with it before youll effectively abandon it to run off chasing the next shiny new tech thing.
I've seen toddlers with better long term focus and planning. Wheres the vision? Wheres your roadmap for the next year of features? Why do you want to add AI support? How is it going to integrate with your existing services? What business use cases does it support? Will it be used and is it affordable for end user's as prices increase? What other features will you have to drop from planning to develop it?
Im sorry but this is almost farcical.
Laurie Annis
May 16, 2024
I love Spatial and the promise of instant infrastructure onto which I can build my games and have multiplayer and streaming out of the box using Unity a game engine I know and love, but for that Spatial to survive, decision makers are going to have to take advice like this seriously. Agree 1000%
spatial
May 16, 2024
We appreciate that feedback! What features do you think we should focus us that would have the biggest impact?
Laurie Annis
May 16, 2024
I think getting the whole Spatial team to pay attention to the massive user community you have cultivated on Discord would be the best first step. I can't speak for everyone there, but it often seems to me as though feedback is asked for by one or two Spatial devs and then never followed up on. It's almost as if we don't exist at times.
Toward that end, tap into the talent of your many game developer users like me and the person above who are active on Discord, champing at the bit to bring our communities to the platform but are floundering without adequate support.
Furthermore, I would love to see the long-ago promise fulfilled of Spatial's internal games (like Punch Hero) being opened up for us community members to learn from and pick apart and use as templates. Instead of Spatial attempting to develop the next blockbuster game internally, let us use those internal games to empower your User Generated Content creators with the tools to build their OWN viral games *edited to add and monetize our own games, the way that Roblox does.
Rob Keanalley
May 16, 2024
Would be amazing to be able to incorporate chat bot NPCs on specific topics to enhance educational spaces.
PinkCryptoBabe
May 16, 2024
Would love to be able to integrate that feature in my spaces
spatial
May 16, 2024
How specifically would you use AI i your spaces?
PinkCryptoBabe
May 16, 2024
Make the Virtual Avatar Daisy from my spaces interact.
spatial
May 16, 2024
Meaning you could have a conversation with your virtual avatar?
PinkCryptoBabe
May 16, 2024
Yes, this my idea from maybe 8 months ago, there are integration which could work in spatial. If you want dm on discord i can send youa link. Kind regards
PinkCryptoBabe
May 16, 2024
It is a behavior trained npc, what i mean..... sorry for the misunderstanding
Joel Miles-Board
May 16, 2024
We have built digital twins for businesses and many ask for this feature to allow visitors to their space to ask questions and have the bot answer them. One client we had to swap from spatial to Mesh just because they needed this feature and Mesh allows api calls. So yes, this would very much be a feature we'd like to see.
G
May 16, 2024
I have honestly been trying for years to confirm that Mesh actually exists and isn't vaporware. Have you actually tried it? Like hands on, headset on face tried it?
G
May 16, 2024
Why would I join a corporate space to ask questions of a bot though? The major benefit of a Space is the interaction with either multiple ppl or the world itself? Like ive heard ppl making spaces that you join to fill in a form... but why?
I can see plenty of uses for AI in gaming / world creation and I can see examples of using AI to manage customers. But combining both feels like a "because we can" product unless the AI and Space has a clear interaction and use to each other and and both have meaning to the user.
An AI that can help me and a teammate debug a Quest in spatial or create images / notes of a meeting we have in spatial or live translate our languages (cough cough if it worked cough) would be amazing.
One that I could simply interact with on a store page though doesnt benefit from the 3d environment much at all? Unless the company literally doesn't have a website and ONLY has a Spatial space in which case it still doesn't benefit but is at least potentially needed.
Mike Cerqua (MetaMike)
May 16, 2024
Id love to see AI avartar agents where anyone can build the AI personality easily without any tech or unity background using Inworld.ai or convai.com. They can create their AI persona themselves then give the url/sku (or whatever they use to reference the account) to someone who might be more comfortable using unity to connect the 3d avtar to the AI persona and give it to the as a spatial unity prefab.
Frank Michael
May 17, 2024
To enhance our Wealth Conglomerate Virtual Arena, we propose integrating the API by OpenAI. This will allow users to interact with AI-powered NPC guides for real-time assistance, engage in adaptive AI-driven quests, and access AI-aided design tools. Additionally, users can learn about specific topics or sectors connected with the Wealth Conglomerate by communicating with tailored AI. These features will elevate our arena into a 24/7 educational and interactive space, enriching user experiences through the Spatial Creator Toolkit.
Laurie Annis
May 17, 2024
AI avatars (chat bots) are neato, but they're not going to make any Spatial space go viral.
Linexperts Metaverso
May 20, 2024
In the case of my team we want to improve the user experience through the spaces with a virtual assistant which has the ability to listen to users, interpret what they say with chatgpt, and then respond by voice again, to solve space and general doubts of the company using the power of an AI like Chatgpt, Whisper or TTS.