Opening the way for new applications of smart devices, Dartmouth researchers have created the first form of real-time communication that allows screens and cameras to talk to each other without the user knowing it.
Using off-the-shelf smart devices, the new system supports an unobtrusive, flexible and lightweight communication channel between screens (of TVs, laptops, tablets, smartphones and other electronic devices) and cameras. The system, called HiLight, will enable new context-aware applications for smart devices. Such applications include smart glasses communicating with screens to realize augmented reality or acquire personalized information without affecting the content that users are currently viewing. The system also provides far-reaching implications for new security and graphics applications.
The findings will be presented May 20 at the ACM MobiSys’15, a top conference in mobile systems, applications and services. A PDF of the study, further information and demonstration videos are available at the HiLight project website.
In a world of ever-increasing smart devices, enabling screens and cameras to communicate has been attracting growing interest. The idea is simple: information is encoded into a visual frame shown on a screen, and any camera-equipped device can turn to the screen and immediately fetch the information. Operating on the visible light spectrum band, screen-camera communication is free of electromagnetic interference, offering a promising alternative for acquiring short-range information. But these efforts commonly require displaying visible coded images, which interfere with the content the screen is playing and create unpleasant viewing experiences.
The Dartmouth team studied how to enable screens and cameras to communicate without the need to show any coded images like QR code, a mobile phone readable barcode. In the HiLight system, screens display content as they normally do and the content can change as users interact with the screens. At the same time, screens transmit dynamic data instantaneously to any devices equipped with cameras behind the scene, unobtrusively, in real time.
HiLight supports communication atop any screen content, such as an image, movie, video clip, game, web page or any other application window, so that camera-equipped devices can fetch the data by turning their cameras to the screen. HiLight leverages the alpha channel, a well-known concept in computer graphics, to encode bits into the pixel translucency change. HiLight overcomes the key bottleneck of existing designs by removing the need to directly modify pixel color values. It decouples communication and screen content image layers.
Read more: Dartmouth team creates first hidden, real-time, screen-camera communication
The Latest on: Context-aware applications
[google_news title=”” keyword=”Context-aware applications” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Context-aware applications
- The key technologies fuelling chatbot evolutionon May 9, 2024 at 12:00 am
RAG systems merge generative AI with information retrieval from external sources on the open web to augment their knowledge base in real time.
- The Role of Edge Computing in IoT Performanceon May 7, 2024 at 10:38 am
Edge computing has emerged as a crucial solution to address the limitations of cloud computing in supporting context-aware and delay-sensitive services in the Internet of Things (IoT) era. This ...
- AppOmni Releases Zero Trust Posture Management, Enhancing SaaS Security by Extending Zero Trust to the Application Layeron May 7, 2024 at 1:59 am
In the context of SaaS applications, traditional network-centric Zero Trust ... This capability allows for real-time and context-aware responses to detected security events or anomalies, such as ...
- Context Matters: A Powerful Question That Helps Us Better Serve Otherson May 6, 2024 at 8:46 am
Discover the power of one transformative question that can deepen connections, foster empathy, and enhance understanding in all your relationships.
- AI: AI Chronicles Help Us To Understand Each Otheron May 6, 2024 at 6:32 am
The future of work, he contends, is that AI should not replace people, but rather, assist them. He shows an organizational chart that Ai chronicles people achieving corporate tasks and the role of the ...
- Context Therapeutics gets $100M financing deal and a key FDA approvalon May 2, 2024 at 9:11 am
Context Therapeutics is advancing its experimental therapy being developed to treat solid tumors in gynecologic and testicular cancers.
- Context essential for online privacy protectionon May 1, 2024 at 2:48 pm
In the current digital age, the re-use of data by online third parties has become a growing concern, highlighting the need for stricter measures to protect privacy and counter misuse of personal data ...
- Securiti AI launches context-aware LLM firewalls to secure genAI applicationson April 30, 2024 at 9:32 am
Architecture at KVAT Food Stores Inc. Power of Proximity & Context-Awareness: Protecting GenAI systems & applications requires more than a traditional perimeter-based firewall approach.
- Securiti AI Launches Context-Aware LLM Firewalls to Secure GenAI Applicationson April 30, 2024 at 6:01 am
Securiti LLM Firewalls are a fundamental ingredient for establishing compliance with major AI regulations, such as the EU AI Act and the NIST AI Risk Management Framework. They also provide key ...
- DeepMind researchers discover impressive learning capabilities in long-context LLMson April 24, 2024 at 7:46 pm
In their study, the DeepMind researchers investigated how many-shot ICL affects the performance of LLMs in downstream tasks.
via Bing News