SENSUS and Open Exhibits – Easy Sharing Between Tables, Tablets & Phones


This video demonstrates the results of a recent collaboration between SENSUS and our own Open Exhibits software initiative.  The concept is simple: make networking and sharing transparent across multitouch devices and operating systems. The demo video shows an Android Tablet (Samsung Galaxy), a Multitouch Table (our own, new MT55), a Windows 7 multitouch kiosk, and an iPod–all sharing media items (images, video, and a Google Map) effortlessly.  This easy sharing is made possible with Konnectus software which is a new cloud-computing platform developed by SENSUS.

The  Konnectus software and the Open Exhibits modules will be available later this summer. And, Yes! These “network friendly” software modules will also work with our GestureWorks multitouch framework.

Here’s a bit more about Konnectus and our partners at SENSUS…

KonnectUs is a new cloud-computing software platform by SENSUS designed to make sophisticated networking functions easy and intuitive for users across a range of devices including multitouch tables, desktop computers, tablets, and mobile phones. KonnectUs “Natural Networking Technology (NNT)” empowers users to connect seamlessly across all major platforms – from Windows to Android to iOS. The new software aims to deliver a desktop user experience for key cloud-based services such as file sharing, social networking and location-relevant distribution of content. Additionally, KonnectUs APIs allow developers the opportunity to leverage the power of SENSUS networking technology through integration into third party applications.

You can read the full-press release on the SENSUS Website.

Easy and Cheap Authoring for the Microsoft Kinect with Open Exhibits

Our module for Kinect provides a simple solution for authoring gesture-based applications in Flash. Lately, we’ve been using it in conjunction with our other free Open Exhibits software modules. While the Kinect device itself doesn’t have the necessary precision for use with every module, we have successfully paired it with our gigapixel image viewer, our new VR Panoramic image viewer, and with our Google Maps module.

Our free Kinect module works with Community Core Vision (CCV) software, an open source software package for computer vision. We’ve used this software in the past with various multitouch tables and other installations. Our Kinect module is a “directshow” source filter, a virtualized webcam device that reads data from the drivers released by OpenKinect.

Here’s a video showing the Kinect module working with other Open Exhibits software.

The Kinect module and the others are all free and open on the Open Exhibits website. The Open Exhibits core software is free for students, educators, nonprofits, and museums. (Commercial users can download a free GestureWorks trial.)  Add a $150 Kinect 3D Motion Controller to our software and you have a very cheap and flexible authoring solution.

There are photographs of the Kinect and Open Exhibits modules on the OE Flickr site.

Kinect Google Maps Viewer

This article is cross-posted on the Open Exhibits Website.In the video, the gigapixel image of El Capitán that appeared in the example was provided by xRez Studio. The cubic VR image of Chichen Itza was taken by Ideum back in 2005 and is part of the Traditions of the Sun project.

Controlling a Gigapixel Image With Kinect

[Cross-posted from Open Exhibits Blog]

We’ve recently released two new modules on Open Exhibits. The gigapixel viewer module allows Open Exhibits and GestureWorks users to plug any gigapixel image into our Flash application and drag and zoom it using multitouch inputs. We recently demo’d this app for the first time at CES 2011 and it was a big hit.

MT-Kinect, our other new module, allows users to interface with a Kinect to manipulate multitouch applications using gesturing (like in the movie Minority Report) rather than directly touching a screen. We combined this module with a gigapixel viewer to create an application that allows you to move and zoom by waving your arms.

So how does our application convert Kinect data to multitouch-compatible input that our Flash application can read? We wrote a “directshow” source filter, a virtualized webcam device that reads data from the drivers released by OpenKinect.

After adjusting the depth data to amplify the edges – which optimizes this application for gestures from a single user centered in the Kinect’s camera – we output a simple webcam feed. We route this information to a vanilla installation of CCV (theoretically, other  trackers should work), which runs various filters, finds the blobs, and outputs the data in whatever format we would like to consume (in our case,”flosc,” which enables Flash apps to get “OSC” information ). Our gigapixel viewer software can then read this input as though it came from any multitouch device.

These modules are free to download and use; you just need to be an Open Exhibits member. The gigapixel viewer requires that you have either Open Exhibits Core or GestureWorks software. Open Exhibits Core is available free to educational users. Commercial users can try GestureWorks free or purchase a license.

And if you’re wondering about the stunning gigapixel image of El Capitán, it was taken by xRez Studio who were nice enough to let us use the image for this demo.

Live From CES: Touchscreens, 3D, Robots and More!

We’re at CES for the first time this year, promoting GestureWorks and our new partnership with Touch Revolution. While we’ve attended many trade shows and conferences, CES is a spectacle unlike any we’ve seen before, and it seems appropriate that it takes place in Las Vegas.

Molecule Viewer - CES

A visitor manipulates a 3D molecule with our Molecule Viewer app

We’ve noticed 3D and touch are two of the year’s buzzwords, appearing everywhere at CES, so our multitouch 3D molecule viewer fits right in. Built specially for CES, the viewer allows you to manipulate a molecule in 3D space. Shown here on the TRū Touch Monitor, the molecule viewer is the most educationally focused application we’re showing this year. The app offers molecular structure and information for five of the active ingredients in Red Bull, which seemed appropriate for a tech conference.

X-ray Viewer - CES

Gene Halsey from Touch Revolution demos our X-ray app

Robots are also a big hit at this year’s CES, even if they just jitter and giggle. We haven’t gotten into robotics (yet), but you can see the X-ray insides of a toy robot with our X-ray viewer. The app allows you to switch from the visible view of an object to the X-ray view with a simple double tap, and was based on one of our most popular exhibits.

And, if you just want to play a game, there’s always Astrotouch, our multitouch version of Asteroids.

We’ll be updating more as the conference goes on.

CES Exclusive: The New Touch Revolution TRū Touch Monitor, Featuring GestureWorks

As we announced yesterday, we recently partnered with Touch Revolution to create a series of GestureWorks applications for their hardware demos. We’ve been lucky enough the past few weeks to get to play around with the new 21.5″ TRū Touch monitors, which Touch Revolution will be debuting at CES. The TRū Touch monitors are full HD (1920 x 1080), bezel-less, and, like these concept screens, you can tilt them to horizontal angles to make tasks like typing and drawing easier.

touch revolution booth

We’ve been testing our apps for CES on the TRū Touch, including an amazing gigapixel image viewer that allows you to zoom in close enough to see rock climbers on El Capitan in Yosemite and a 3D object viewer, but so far the hands-down favorite has been Astrotouch, our multitouch version of Asteroids.

Setting Up at CES

The game has a series of old school-style arcade controls at the bottom, and we’ve been nothing but impressed with the screen’s responsiveness and accuracy. Some of the other hardware we had in-house had trouble with ghost points on the controls, but the TRū Touch screen handled it flawlessly every time.

Check out the video above for a sneak peek at the new Touch Revolution hardware, and be sure to visit us at CES. We’ll be at the Touch Revolution Booth, #21755, South Hall Lower Level with a full set of great multitouch applications on display and free gesture illustration posters to give away.

GestureWorks 2.0 – Multitouch for Flash and Flex

I’m very happy to announce the release of a major update to our GestureWorks multitouch authoring frameworks for Adobe Flash and Flex.  The new version has some great new features, most notably over 200 built-in gestures and the ability to incorporate Open Exhibits software modules. A GestureWorks 2.0 commercial license costs $249. We are providing free upgrades to any GestureWorks 1.x users.

In addition to the new software release, we’ve also redesigned the GestureWorks website. The front page is now multitouch-enabled.  The support system and documentation areas of the website have been completely revamped, with an expanded FAQ, a new issue tracking system, and a comprehensive GestureWorks manual. We’ve also added Google Checkout to the options for payment in the store.

In addition, we’ve updated our popular gesture poster to reflect the gesture support in the new release. The poster and the gesture artwork are released under a Creative Commons Attribution – ShareAlike license.

You can download the Open Source Gesture Library poster and illustrations on the GestureWorks site.

Building a High-Resolution Multitouch Wall (Part 1)

For the latest installments see: Building a High-Resolution Multitouch Wall (Part 2), Building a High-Resolution Multitouch Wall (Part 3) , Building a High-Resolution Multitouch Wall (Part 4) and Building a High-Resolution Multitouch Wall (Part 5).

We’ve just begun work on our most ambitious installation to date: a 7′ round, high-resoultion, multitouch wall. The exhibit is being built for a major North American aquarium and it will be installed in early summer 2011. We are building out a rig to hold two short-throw HD projectors and four cameras.  A powerful custom-built  PC will be used for tracking and powering the projectors.

Here are some photos of us getting started. Paul Lacey, Chris Steinmetz and I will post updates as we continue to build out the exhibit over the next few months.

The 7 foot ring getting into the studio

The seven foot ring being placed in Ideum’s Studio. (More on Flickr)

Monster Sized PC

A huge aluminum case (25.24″ x 8.66″ x 24.92) is needed to house the EVGA Classified EATX System board.

Here are the rest of the specs for the system:

Intel Core i7 Extreme Edition 975 3.33 GHz
nVidia Quadro FX 5800 4GB GDDR3
12GB Corsair Dominator DDR3
2x 300GB 10,000 RPM WD Velociraptor Hard Disk Drives (RAID 1)
920Watt Enermax 85+ Power Supply
3 PCIE Firewire Cards (cameras)
Windows 7 Pro 64bit

We’ll post an update as we begin to build out the projector rig.

Introducing Open Exhibits

open exhibits dashboard designOn September 21st, I announced that we received funding for Open Exhibits from the National Science Foundation.  It is great to be able to announce today, just two months later, that Open Exhibits core software and a new community site are now available at OpenExhibits.org.

We are, by just about any measure, off to a very fast start.  While Open Exhibits is a three-year exhibit software initiative, we know how hard it is to develop a community of practice and we understand that it takes time. Quickly releasing software and developing a site that allows our community to take root is the first step.

On the Open Exhibis site, you’ll find Open Exhibits Core software, which includes support for multitouch gestures within Adobe Flash and Flex. Along with the core, the first open source templates and modules are also available. These templates and modules will allow developers to easily create interactive exhibits. All of this software is free for museums, nonprofits, universities, students, and other educational organizations. (Commercial users of GestureWorks can also use the templates and modules and are encouraged to contribute.)

The Open Exhibits site allows for software downloads and uploads and there is a community blog that any member can contribute to. In addition, the site has personal profiles, tutorials, support, and documentation. New features will be rolled out over the next few weeks.

I would be remiss if I didn’t mention the fantastic team at Ideum that helped put all this together. Chad Person is the Open Exhibits project manager and helped design and oversee the site. Danillo Stern-Sapad is the main site developer (we built the site in Drupal). Erin Rose is a content developer and social media outreach specialist and helped with the tutorials and blog. James “Glass” Cartwright was the CSS master for the site, while James Kassemi helped with database and Javascript implementation. Open Exhibits software developers Matt Valverde and Paul Lacey put together all of the modules and templates. They also worked with Chris Gerber to put Open Exhibits Core together, implementing the new module and gesture support, as well as an extensive set of documentation.

We encourage you to check out Open Exhibits and join us. We are just getting started.

Computer Exhibits in Museums Survey and Open API

We’ve been mighty busy around here with the Open Exhibits initial software release and site relaunch just around the corner (coming November 15), but we have found time for other important and related work.

We’ve just posted a call for participation in our third annual Computer-Based Exhibits in Museum Survey on the Open Exhibits Website.  We’ve managed to have over 250 respondents to the last two surveys, representing hundreds of museums all over the world. You can see the previous survey results on the Open Exhibits website. We plan to release the survey results in early December. Those who complete the survey will be able to see the results first.

Also, earlier in the week, we released an alpha build of Open API, a program that allows developers to create a public API of a collection or any other MySQL database. This is not to be confused with the larger release of Open Exhibits core in November, which is a multitouch-enabled Flash and Flex-based software (Open API is built using Ruby), but we do plan on releasing other types of software modules that can help museums develop computer-based exhibits. At the moment, only a handful of museums have open APIs for their collections.

You can read the full post on Open API on the Open Exhibits blog.

Open Exhibits – Free Release and New Website, November 15

>>Reposted from Open Exhibits blog.


Last month, we announced that we received funding from the National Science Foundation for Open Exhibits. Today we’re happy to announce that, on November 15th and just 60 days after being funded, Open Exhibits 1.0 will be available free to educational organizations.

The Open Exhibits core software along with six modules and one template will make up the initial release. Open Exhibits core is based on our commercial GestureWorks software package.

Open Exhibits core is a multitouch framework for Adobe Flash and Flex. The open source modules and templates will be interoperable with GestureWorks 2.0 (to be released December 9) and free to all developers. Modules are functional components that can be used as building blocks for templates and exhibits. Templates are stand-alone applications that can be populated with content and customized via external XML files.

Here’s a run down on the software that will be available November 15th on the Open Exhibits Website.

Open Exhibits core: Available free to any museum, educational organization, nonprofit, or student. It is essentially a free educational version of GestureWorks (it does require registration). It has built-in gesture support (eventually for over 200 gestures), a built-in multitouch simulator, and an open source gesture library.

Onscreen Keyboard (module)  - A multitouch-enabled, scaleable, rotatable, and “skinable” onscreen keyboard.

Image Viewer (module) – A “local” image viewer that can handle PNG, JPEG, SWFs and other Flash-friendly file formats. Multitouch gestures can be used to scale and rotate the images.It supports basic metadata (title, description, author, and publish) via an external XML file. It can be skinned and some parameters can be changed via XML.

The Image Viewer Module

Video Viewer (module) – A “local” video viewer that plays .FLV video files. Multitouch gestures can be used to scale and rotate the videos. It too supports basic metadata (title, description, author, and publish) via an external XML file. It also supports captions and it can be skinned and some parameters can be changed via XML.

Flickr Viewer (module) – A Flickr image and video viewer. This module can draw media from a Flickr account or group. Multitouch gestures can be used to scale and rotate the images and videos. It requires a Flickr API key. It supports basic metadata (title, description, author, and tags). It can be skinned and some parameters can be changed via XML.

YouTube Viewer (module) – A viewer that can play YouTube videos. It has basic video controls. Multitouch gestures can be used to scale and rotate the videos. It requires a YouTube API Key. It can be skinned and some parameters can be changed via XML.

Google Maps (module) – A module that allows a Google Map to be controlled via multitouch gestures. It requires a Google Maps API key. Some parameters can be changed via XML.

CollectionViewer (template) – A collection viewer that incorporates all of the viewer modules. It can connect to local or networked images and videos. It has support for multitouch gestures (and multiple users). The look and functional aspects of the application can be controlled via XML. The template can be populated with content and become a stand-alone exhibit or it the source code can be modified.

These initial modules and templates will be extended and modified as Open Exhibits continues. Additionally, the new site will allow other developers the ability to build off these components or submit their own components to share with the community. The fun begins on November 15th!

Join
Name:
Email:
or Cancel

Join our mailing list

Receive periodic updates and be notified of updates

RSS Feed RSS