War Rooms for High Stakes Decision-Making

Making decisions under time pressure is difficult. The pressure only goes up when complex data must be understood to make the decisions and significant amounts of money are involved. I am co-leading an effort to build war rooms that help professional sports teams make decisions under these challenging conditions. These rooms use large wall and table touch screens to display key complex data, custom software to support fluid interaction across multiple displays (and with remote participants), and new user interface approaches suited to the new environment and high-pressure tasks at hand. The first war room has gone live for the Toronto Raptors.

youtube // techcrunch

360° Camera Collaboration

Gaze is a powerful form of social feedback, providing cues about attention and interest, and boredom and distraction. We designed and built a system that enables remote participants in a collocated meeting to look around the local meeting space, and that showed local participants where the remote participants were looking. Of course, pointing a camera is not the same as gazing, and so we conducted a study to understand how simulated gazes might be used, and to what extent they would be experienced as social cues. Findings range from the use of simulated gaze to signal attention, to ways in which local and remote participants experienced these simulated gazes. These findings illustrate the value of indirection and abstraction in presenting social cues; raise issues of privacy, visibility, and participation asymmetry; and suggest implications for design and further research.

acm dis paper

Rapid Prototyping for Cognitive Environments

Cognitive Environments are richly instrumented spaces that feature a multitude of sensors, displays, input mechanisms, and smart devices. Such environments afford a variety of rich interactive experiences. However, building those experiences is often complex and time consuming. I created a suite of scripting tools that allow users to quickly prototype experiences in such environments by providing a straightforward programming language that allows novices to exercise the same room APIs as expert developers. In this way, users can quickly simulate what the completed experience would be like. The scripts also serve as scaffolding -- allowing users to move from prototype to completed application by replacing segments of scripts with fully functioning code bit-by-bit. This approach was used in our work for Repsol and others.

cognitive technologies for repsol

Visualization for Medical and Social Care

Medical, social work, and other health professionals often have patients in common, but collaboration among these roles is a challenge. I built a set of interactive visualizations that integrate data from a variety of sources and aim to facilitate appropriate coordination among caregiving roles. The visualizations provide a rich, evolving picture of the patient in their social and medical context. I am working on an interdisciplinary team to design and evaluate these tools. Research issues include design for disparate roles, collaborative visualization, privacy, and information integration.

ibm journal of r&d article

Mobile Applications for the Developing World

Five of the the six billion people on Earth do not have access to computing technology. But that's changing. In Africa, for example, mobile phone subscribers have jumped from 10 million to 400 million between 2004 and 2009. What does it mean to make software that specifically targets these markets? Can social software empower the poor in new and meaningful ways? Social computing has the potential to play a transformative role in the developing world, but tapping that power will require a radical rethink of how we design, build, and profit.

project website // manifesto

Serious Games in Virtual Worlds

Workers are becoming increasingly distributed, from the far-flung collaborators of open source to worldwide corporations. As team members move further apart in space and time, they lose opportunities for face-to-face interaction and the rich possibilities for team building those interactions bring. This project looks at ways serious games (games that are truly fun and encourage learning) in virtual worlds (like Second Life) might help bridge the gap.

project website // games on my blog

Social Visualization in Software Development

Many software development tools focus on supporting the primary technical work – writing code, managing requirements, filing bugs, etc. Yet with large teams, managing the social aspects of a project can be as complex as managing code. Visualizing social aspects of such projects can help make it easier to find problems and respond appropriately. A key mechanism of the approach has been patented.

chi paper // cscw paper

gro.sillej @ ih

For more projects, publications, and patents, see my cv »