AR Authoring for Urban Planning and Product Design

AR Authoring

for Urban

Planning

and Product Design

AR Authoring

for Urban

Planning

and Product Design

Eng. Pedro

Santos

pedro.santos@iscte.pt

Prof. Miguel Dias

miguel.dias@iscte.pt

ADETTI/ISCTE/Portugal - Jan 2005

This work is part of an Msc thesis in Computer and Telecom. Engineering – Computer Graphics www.adetti.pt

www.iscte.pt www.magic-reality.com

VR-NET Seminar on Virtual Reality

Visualisation and Modelling of Cities

and Terrains Northumbria University,

28th January 2005

Summary

Summary



State-of-the-art



Tangible interaction for Architectural and Industrial

Design



Authoring tools for AR Design applications



The ‘Performance Plaza’ AR authoring tool



User requirements

System architecture

Tangible interaction for

Architectural and

Industrial Design

Tangible interaction for

Architectural and

Industrial Design

State-of-the-art

Augmented Urban Planning Workbench:

Overlaying Drawings, Physical Models and

Digital Simulation

 _{“Luminous Table”: Augmented Reality Workbench that}

integrates multiple forms of physical and digital representations.

 _{2D drawings, 3D physical models, and digital simulation}

are overlaid into a single information space in order to support the urban design process.

Hiroshi Ishii, John Underkoffler Dan Chak, Ben Piper MIT Media Laboratory

Eran Ben-Joseph, Luke Yeung*, Zahra Kanji

Inexpensive Non-Sensor Based Augmented Reality

Modeling of Curves and Surfaces in Physical Space

Adrian David Cheok, Neo Weng Chuen Edmund

and Ang Wee Eng

National University of Singapore

 _{Augmented reality system where a user can model}

surfaces with his hands, and without expensive sensing systems.

 _{The system uses computer vision based methods for the}

tracking of the user’s head and hand position.

 _{Using a glove and the tracking system, the user can draw}

smooth lines or surfaces with her hands in a physical space.

MagicCup: A Tangible Interface for Virtual

Objects Manipulation in Table-Top AR

 _{City-planning system based on augmented reality with}

tangible interface.

 _{Tangible interface for virtual object manipulation in}

table-top augmented reality based on ARToolKit.

 _{User holds a transparent cup upside down and can pick}

up, move or delete a virtual object by using it.

Hirokazu Kato, Keihachiro Tachibana, Masaaki Tanabe, Takeaki Nakajima,

Yumiko Fukuda.

Osaka University, Hiroshima City University, Knack Images Production Center, Hiroshima Institute of Technology

Interactive Mediated Reality

Vienna, Austria



_{Mediated reality describes the concept of filtering our}

vision of reality, typically using a head-worn video

mixing display.



_{Proposes a generalized concept and new tools for}

interactively mediated reality.



_{First prototype system for painting, grabbing and}

Collaborative Augmented Sketching



_{Software prototype using AR Toolkit for}

collaborative augmented reality sketching in

architectural design.



_{Non-intrusive interaction technique developed for}

this prototype.



_{Sketching and distribution mechanisms are}

discussed and illustrated.

Hartmut Seichter Department of Architecture The University of Hong Kong

Collaborative Mixed Reality Visualization of

an Archaeological Excavation

 _{VITA (Visual Interaction Tool for Archaeology) tool.}

 _{Experimental collaborative mixed reality system for}

offsite visualization of an archaeological dig.

 _{System allows multiple users to visualize the dig site in}

a mixed reality environment.

 _{Tracked, see-through, head-worn displays are}

combined with a multi-user, multi-touch, projected table surface, a large screen display, and tracked hand-held displays.

Authoring tools for

AR Design applications

Authoring tools for

AR Design applications

State-of-the-art

Mix It

 _ADETTI.

 _{Visual interface for authoring AR/MR.}

 _{Magic Book metaphor. Books are made of markers and associated 3D models.}  _{Editor + AR Viewer.}

AMIRE



_{A Mixed Reality Authoring tool.}



_{The main objective of AMIRE is to enable}

non-expert researchers:



to use Mixed Reality (MR) for their applications

to create and modify these MR applications

with the support of dedicated tools that foster

an efficient authoring process for MR.

Authoring of a Mixed Reality Assembly

Instructor for Hierarchical Structures



_{Mixed Reality based step-by-step furniture}

assembly application.



_{Context related actions are given to the user to}

install elements.



_{Intuitive way for authors to create new MR based}

assembly instructions.

Jurgen Zauner, Michael Haller, Alexander Brandl Upper Austria University of Applied Sciences (MTD), Austria

Werner Hartmann Institute for Applied Knowledge

DART: The Designer’s Augmented

Reality Toolkit

 _{Designer’s Augmented Reality Toolkit (DART).}

 _{Allows users to easily create augmented reality (AR)}

experiences.

 _{Can be used by technologists, designers and students}

alike.

 _{Rapidly prototype AR applications without extensive}

programming and content creation as well as knowledge of technical topics involving cameras, trackers, and 3D geometry.

 _{http://www.gvu.gatech.edu/dart/}

Blair MacIntyre, Maribeth Gandy, Jay Bolter, Steven Dow,

Brendan Hannigan Georgia Institute of Technology,

Immersive Authoring of Tangible Augmented

Reality Applications



_{New approach for authoring tangible augmented}

reality applications, called ‘immersive authoring.’



_{Allows the user to carry out the authoring tasks}

within the AR application being built.



_{The development and testing of the application can}

be done concurrently throughout the development

process.

Gun A. Lee α Claudia Nelles β Mark Billinghurst β Gerard Jounghyun Kim α α Pohang University of Science and

Technology

DesignAR



_{DesignAR allows a way of authoring augmented}

reality environments without needing to write code in

C++ or other programming languages.



_{The environment centers around Touch Designer, a}

commercial 3D modelling package by Derivative.



_{http://www.mis.atr.co.jp/~rodney/designAR/index.htm}

Rod Berry ATR Media Information

The ‘Performance Plaza’

AR authoring tool

The ‘Performance Plaza’

AR authoring tool

User requirements



_{Project partner (User Requirements):}



NOA - Design agency in Germany.



Develops modern 3D products in the context of market,

communication, technology and production.

 _{Specification of the core technology: MxToolkit}

 Handles user interaction, hardware interfaces, system management, etc

 Independent of application to be developed; provides generic programming

language mechanisms for VR/AR/MR applications.

 _{Specification of a new AR authoring tool: Performance Plaza}

 _{Based in MxToolkit.}

 Geared towards designers and 3D artists.

 _{Proposes a visual and intuitive new Human-Computer Interaction technique.}

 _{Two different work paradigms: design and presentation}

 Design: interactively prepare 3D models for presentation.

User requirements



_{Design phase:}



Highlight and select subscenegraphs of

3D models.



Transform, measure, cut and change

appearance of models.



Insert text and voice anotations.



Allow model version control based in

product development timeline. E.g.:

problem level model, concept level

model, design level model, realization

level model.



With

these

operations

author

a

“powerpoint-style” 3D presentation:



Timeline based.



User’s (designer, architect, engineer,

marketeer) actions trigger events.



Create

automatic

or

event-based

User requirements



_{Presentation phase:}



Users interact with models (view, pick, move around, etc).

Arrange models in a life-situation.



Show or hear, select and change text and voice annotations.



See/switch

between

time-related

and

speciality-related

(architect, designer, engineer, marketeer) model versions.



Launch presentation prepared in Design phase; trigger events

and animations.

System architecture



_Hardware

 Peripherals: webcam(s), microfone, speaker.

 Input devices: human hand, AR fiduccial marker(s), keyboard (or equivalent for text anotations).

 Output devices: computer monitor, HMD, “Paycheck” screen.



_Software

Marker-based Tracking Image Processing

Tangible User Interfaces

Performance Plaza

System architecture

Thank you for your attention!

AR Authoring for Urban Planning

and Product Design

www.adetti.pt

www.iscte.pt www.magic-reality.com

Eng. Pedro Santos

Prof.

Miguel Dias

pedro.santos@iscte.pt miguel.dias@iscte.pt