GowanusAR

Medium: 

AR iOS App

Role: 

AR UX Co-ideator/Designer/Engineer

Tools: 

Unity, C#, AR Foundation, ARKit, Core Haptics, Spatial Audio, Mapbox SDK

For: 

Media Artist Sarah Drury

Year: 

In Progress

Collaborator(s): 

Sarah Drury, Alma Hutter, Van Alen Institute, Austin Martin

Process

{{sect1}}

~~ Autumn 2024 Updates (Please See Sections Further Below for an Overview of the App)

Currently we are focused on iterating on one of the app's 7-9 scenes, focused on the canal's industrial and shipping history. We aim to develop a full-fledged version of this scene by the end of the year and extensibly apply the scene's underlying UX flow to the remainder of the evolving scenes in the new year.

Most recently we have been working on fleshing out the animations within this industrial scene, including more realistically embedding the Gaia figure within the canal landscape via water surface ripples, conveying her more flexible and amorphous form hinting at her ineffability via frequent body "disintegration" animations, and adding more dynamic bodily gestures for her that sync up with her voiceover narratives:

Screenshot showing the new water surface ripple effect around the Gaia figure's base in the Unity Editor

Screenshot showing the more dynamically embedded canal skeleton within the Gaia figure in the Unity Editor

Screenshot showing the Gaia figure's bodily form "disintegrating" effect in the Unity Editor

We had a user testing session in October with several local artists and designers, which validated our Gaia figure design trajectories and reminded us to pay careful attention to assets' scale and clarify interactivity indicators for more intuitive UX.

Here is some documentation from that day:

A user tester exploring the "Industry / Shipping History" GowanusAR scene

More user testers exploring the "Industry / Shipping History" GowanusAR scene

Our user testers exploring the intro "Tide Mill" GowanusAR scene

Here's a video walkthrough of the Industry / Shipping History scene iteration from October:

~~ Spring 2024 Updates
Exhibition Acceptance

We recently got accepted into the inaugural Meaningful XR Conference (at Stanford in May) to showcase GowanusAR's novel design features in a poster exhibit.

Exhibition Poster

It was phenomenal to be able to join a group of diverse XR innovators from around the world and share amongst each other about uniquely meaningful use cases.

Here are some photos from the experience:

Our final poster draft

My collaborator Sarah presenting our poster to a group of XR-passionate students

Sarah discussing our project with a fellow Temple University-based media arts researcher

How we demo'd the video walkthroughs of some of GowanusAR's scenes; thankful for cute thumbtacks

Entering the gorgeous Stanford campus

Here's a video walkthrough of an iteration of our "Sponge Park" scene recorded within the Unity Editor: 

~~ Winter 2024 Updates

After three rounds of user testing in 2023 and many iterations exploring our evolving vision, we have reached a crystallization of the app's form and content:

  • 9 walking tour AR experience sites
  • A 3D navigation map that guides the user to each of the sites
  • The core UX of interacting with 3D content to uncover stories of the canal's past, present, and future
  • Variations of an animated "Gaia figure" telling the user these uncovered stories at each site
  • The narrative conclusion of the app, including a collective Gaia figure ritual and takeaway for the user of a stitched-together media tapestry recounting their journey

We're aiming to complete our updates to each of the sites and ship a user-ready version of the app in the App Store within the next month.

~~ New demo video(s) forthcoming!

Screenshot of an in-development interactive AR scene in the Unity Editor

A Gaia figure pouring out floodwater in an AR scene on-site at the Gowanus Canal, next to my collaborator, Sarah Drury

A Gaia figure floating in the sky

{{sect2}}

Overview

I've been collaborating with media artist Sarah Drury on the research, design, and development of a mobile AR app that tells interactive stories of past and speculative future land development around the Gowanus Canal in Brooklyn, NY.

{{sect3}}

Inspiration

Sarah Drury, as a resident of a neighborhood bordering Gowanus, grew interested in the canal as a site of contested political and ecological issues. These include:

  • its history of colonial development (starting with Dutch settlers' construction of "tide mills" for their farms)
  • its history of industrial development (with layers of pollution stemming from sewage overflow and former gas plants and oil refineries)
  • its being designated a federal Superfund site in 2010, laying plans for the Gowanus Rezoning (which allows 80 square blocks of residential high-rises)
  • reflecting on these colliding issues of ecological remediation, gentrification, and possible sustainable development, activists and designers have been envisioning alternative solutions for the past two decades

Inspired by these envisioned solutions, Sarah got the idea of literally visualizing them in an AR app that explores "alternative urban development and sustainability in the context of a densely built urban wetland." She invited me on board, and we started meeting to map out the design and technical requirements.

{{sect4}}

Approach

Via an AR iOS app, we are designing a guided tour around the future site of Gowanus Green, planned as an affordable, below-market-rate housing development, to be built along the Gowanus Canal in Brooklyn, New York.

It tells the history of the canal's development and visualize future development plans, including interactive "data stories" about social, ecological, and health impacts, such as added wastewater per building.

I'm developing the app in Unity with C#, AR Foundation, and third-party plugins such as the Mapbox/ArcGIS Maps SDK and support for Apple's Core Haptics API, with the following features:

  1. An interactive walking tour map
  2. Data layers such as sewer infrastructure, underground waterways, and rezoning plans
  3. Hotspots along the Gowanus Canal where users can experience content in AR
  4. Within these AR experiences, interactive "data stories" brought to life by 3D animations, audio recordings, text, haptic vibrations, and GIS data

Along the way, we're inviting contributions from local stakeholders, residents, artists, advocates, and landscape designers, such as audio narratives, 3D models, design projections, and information.

{{sect5}}

Outcome

Currently in development (through Spring 2025)

{{sect6}}

Process Sketches

artist's rendering of hotspot sites for AR content along the canal

early Unity mockup of an image marker triggering the reveal of a wireframe building with a wastewater animation

Process

{{sect1}}

~~ Autumn 2024 Updates (Please See Sections Further Below for an Overview of the App)

Currently we are focused on iterating on one of the app's 7-9 scenes, focused on the canal's industrial and shipping history. We aim to develop a full-fledged version of this scene by the end of the year and extensibly apply the scene's underlying UX flow to the remainder of the evolving scenes in the new year.

Most recently we have been working on fleshing out the animations within this industrial scene, including more realistically embedding the Gaia figure within the canal landscape via water surface ripples, conveying her more flexible and amorphous form hinting at her ineffability via frequent body "disintegration" animations, and adding more dynamic bodily gestures for her that sync up with her voiceover narratives:

Screenshot showing the new water surface ripple effect around the Gaia figure's base in the Unity Editor

Screenshot showing the more dynamically embedded canal skeleton within the Gaia figure in the Unity Editor

Screenshot showing the Gaia figure's bodily form "disintegrating" effect in the Unity Editor

We had a user testing session in October with several local artists and designers, which validated our Gaia figure design trajectories and reminded us to pay careful attention to assets' scale and clarify interactivity indicators for more intuitive UX.

Here is some documentation from that day:

A user tester exploring the "Industry / Shipping History" GowanusAR scene

More user testers exploring the "Industry / Shipping History" GowanusAR scene

Our user testers exploring the intro "Tide Mill" GowanusAR scene

Here's a video walkthrough of the Industry / Shipping History scene iteration from October:

~~ Spring 2024 Updates
Exhibition Acceptance

We recently got accepted into the inaugural Meaningful XR Conference (at Stanford in May) to showcase GowanusAR's novel design features in a poster exhibit.

Exhibition Poster

It was phenomenal to be able to join a group of diverse XR innovators from around the world and share amongst each other about uniquely meaningful use cases.

Here are some photos from the experience:

Our final poster draft

My collaborator Sarah presenting our poster to a group of XR-passionate students

Sarah discussing our project with a fellow Temple University-based media arts researcher

How we demo'd the video walkthroughs of some of GowanusAR's scenes; thankful for cute thumbtacks

Entering the gorgeous Stanford campus

Here's a video walkthrough of an iteration of our "Sponge Park" scene recorded within the Unity Editor: 

~~ Winter 2024 Updates

After three rounds of user testing in 2023 and many iterations exploring our evolving vision, we have reached a crystallization of the app's form and content:

  • 9 walking tour AR experience sites
  • A 3D navigation map that guides the user to each of the sites
  • The core UX of interacting with 3D content to uncover stories of the canal's past, present, and future
  • Variations of an animated "Gaia figure" telling the user these uncovered stories at each site
  • The narrative conclusion of the app, including a collective Gaia figure ritual and takeaway for the user of a stitched-together media tapestry recounting their journey

We're aiming to complete our updates to each of the sites and ship a user-ready version of the app in the App Store within the next month.

~~ New demo video(s) forthcoming!

Screenshot of an in-development interactive AR scene in the Unity Editor

A Gaia figure pouring out floodwater in an AR scene on-site at the Gowanus Canal, next to my collaborator, Sarah Drury

A Gaia figure floating in the sky

{{sect2}}

Overview

I've been collaborating with media artist Sarah Drury on the research, design, and development of a mobile AR app that tells interactive stories of past and speculative future land development around the Gowanus Canal in Brooklyn, NY.

{{sect3}}

Inspiration

Sarah Drury, as a resident of a neighborhood bordering Gowanus, grew interested in the canal as a site of contested political and ecological issues. These include:

  • its history of colonial development (starting with Dutch settlers' construction of "tide mills" for their farms)
  • its history of industrial development (with layers of pollution stemming from sewage overflow and former gas plants and oil refineries)
  • its being designated a federal Superfund site in 2010, laying plans for the Gowanus Rezoning (which allows 80 square blocks of residential high-rises)
  • reflecting on these colliding issues of ecological remediation, gentrification, and possible sustainable development, activists and designers have been envisioning alternative solutions for the past two decades

Inspired by these envisioned solutions, Sarah got the idea of literally visualizing them in an AR app that explores "alternative urban development and sustainability in the context of a densely built urban wetland." She invited me on board, and we started meeting to map out the design and technical requirements.

{{sect4}}

Approach

Via an AR iOS app, we are designing a guided tour around the future site of Gowanus Green, planned as an affordable, below-market-rate housing development, to be built along the Gowanus Canal in Brooklyn, New York.

It tells the history of the canal's development and visualize future development plans, including interactive "data stories" about social, ecological, and health impacts, such as added wastewater per building.

I'm developing the app in Unity with C#, AR Foundation, and third-party plugins such as the Mapbox/ArcGIS Maps SDK and support for Apple's Core Haptics API, with the following features:

  1. An interactive walking tour map
  2. Data layers such as sewer infrastructure, underground waterways, and rezoning plans
  3. Hotspots along the Gowanus Canal where users can experience content in AR
  4. Within these AR experiences, interactive "data stories" brought to life by 3D animations, audio recordings, text, haptic vibrations, and GIS data

Along the way, we're inviting contributions from local stakeholders, residents, artists, advocates, and landscape designers, such as audio narratives, 3D models, design projections, and information.

{{sect5}}

Outcome

Currently in development (through Spring 2025)

{{sect6}}

Process Sketches

artist's rendering of hotspot sites for AR content along the canal

early Unity mockup of an image marker triggering the reveal of a wireframe building with a wastewater animation

Outcome

Other work

Want to create something awesome? Drop me an email.

→ Hi@email.com