Xi IoT - Deepomatic Demo Application Guide¶
Explore a gesture recognition demo application, as seen at .NEXT 2019. Some other gestures have been included, can you find them all?
Xi IoT Overview¶
The Nutanix Xi IoT platform delivers local compute and AI for IoT edge devices, converging the edge and cloud into one seamless data processing platform. The Xi IoT platform eliminates complexity, accelerates deployments, and elevates developers to focus on the business logic powering IoT applications and services. Now developers can use a low-code development platform to create application software via APIs instead of arduous programming methods.
Xi IoT Trial¶
This Xi IoT demo leverages the Xi IoT Trial. The trial is a limited-time, ready-to-deploy implementation of the Xi IoT edge computing platform. The Xi IoT Trial provides pre-built applications and data connectors hosted on its own infrastructure. This instant architecture demonstrates how to quickly develop and test IoT applications in the cloud for seamless deployment to the edge.
Nutanix has already created the basic infrastructure you need to get started.
What’s In the Xi IoT Trial?
- Xi IoT management console, which provides the base for your Xi IoT trial.
- A Starter project that includes:
- You (the project user).
- Xi Edge stack, connected and ready to go: no cluster or bare-metal resources required on your part.
- Deepomatic demo application, just waiting for your gestures.
- Xi IoT Sensor smartphone app for video input.
What else can I do with the Xi IoT Trial?
- Stream video from YouTube-8M video or your smartphone to the Xi Cloud edge.
- Automatically run containerized apps at the edge to perform object recognition on your video.
- Stream the results back to the Xi IoT console or your smartphone, with recognized objects highlighted in your video.
Signing Up For the Xi IoT Trial¶
Do any of these steps to sign up for the Xi IoT Trial.
- Click Start Trial at https://www.nutanix.com/products/iot/ or https://iot.nutanix.com.
- Sign up now for a My Nutanix account at https://my.nutanix.com.
- If you already have an account, log on to https://my.nutanix.com with your existing account credentials and click Learn More in the Xi IoT panel.
SUPPORT FOR AND LEARNING MORE ABOUT XI IOT
The most support for the Xi IoT trial is available through the Nutanix Next Xi IoT trial forum. Nutanix asks that you share your experiences and lessons learned with your fellow users.
You can also visit the following pages for more information about Xi IoT.
Getting Started With the Xi IoT Trial¶
- Log on to the Xi IoT management console.
- On your smartphone, download the Xi IoT Sensor app (available from the Google Play Store).
Logging On to the Xi IoT Console¶
Before you begin:
Supported web browsers include the current and two previous versions of Google Chrome. You’ll need your My Nutanix credentials for this step.
- Open https://iot.nutanix.com/ in a web browser, click Log in with My Nutanix and log on with your My Nutanix credentials.
- If you are logging on for the first time, click to read the Terms and Conditions, then click to Accept and Continue.
- Take a few moments to read about Xi IoT, then click Get Started.
Your web browser displays the Xi IoT dashboard and the Xi IoT Quick Start Menu.
Using the Deepomatic Demo and Xi IoT Sensor Apps to Detect Gestures in Your Smartphone Video¶
About this task
Connect your Android based phone (iPhone coming soon) as a data source to stream video and perform gesture detection in near realtime using Xi IoT. Output can be viewed on your phone and from an HTTP Live Stream (HLS) in your browser.
If you are not logged on, open https://iot.nutanix.com/ in a web browser and log in.
Connect your phone through the Quick Start menu.
- Click Quick Start, then click Scan QR code to connect a phone.
- Open the Google Play Store on your Android based phone, search for Xi IoT Sensor, and install the app on your phone.
- After downloading and installing the Xi IoT Sensor app, scan the QR code to authenticate.
- Enter a name for your phone, then click Next.
From the Xi IoT management portal, Click > Apps and Data > Data Pipelines.
The phone-object-detection data pipeline is connected to the phone data source and started by default. Since this data pipeline is not used as part of this tutorial, it can be stopped.
On the phone-object-detection data pipeline tile, click Actions, then Stop, then Stop again.
Click > Apps and Data > Applications.
On the deepomatic-demo application tile, click Actions, then Start, then Start again.
Open the Xi IoT Sensor app on your phone, and tap the button to switch to the front facing camera.
Tap Capture Video, and wait up to 30 seconds for the deepomatic-demo application to initialize.
Switch to the deepomatic-demo tab to view the results. Try making the gestures seen on stage at .NEXT 2019, or try your own to see if they’re recognized!
From the Xi IoT management portal, click View Http Live Stream on the deepomatic-demo application tile. This opens HLS output for viewing the results in your browser.
Click to close the HLS page.
From the Xi IoT Sensor app, press to stop capturing video.
The containerized deepomatic-demo application utilizes built-in Xi IoT input and output connectors. Learn more about using your phone or a YouTube-8M video as a data source, and a HTTP Live Stream as output when writing your own applications for Xi IoT by further exploring the deepomatic-demo application.
On the deepomatic-demo application tile, click Actions, then Edit.
The General Information page displays information about the application such as its Name, Description, the Project its assigned to, and the edges on which its assigned to run.
The Yaml Configuration page lists the application pod’s specification YAML in Kubernetes format.
The Input and Output page provides the option to use a YouTube-8M video or Xi IoT Sensor phone app as input and a HTTP Live Stream (HLS) as an output for applications. Simply check the appropriate boxes, and install a NATS client within your application. The selected input will be available on the NATS topic name stored in the NATS_SRC_TOPIC environment variable. Subscribe to it using the NATS server name stored in the NATS_ENDPOINT environment variable. Application output in jpeg format sent to the topic name stored in NATS_DST_TOPIC will be available via the application’s HTTP Live Stream.
Click to close the application without making any changes.
From the Xi IoT management portal, click Actions, then Stop, then Stop again on the deepomatic-demo application tile.