Virtualizing Brick-and-Mortar Stores through Augmented Reality for Advanced Online Shopping

Date:

Share post:

By Amy Gu

Online shopping has been growing healthily in just about every category of product. Though the market did not seem to need further motivation, the recent worldwide pandemic accelerated its growth. According to Rakuten Intelligence, ecommerce spending has jumped up around 30 percent compared to pre-pandemic figures. Are vendors adapting online shopping experiences to meet this fueled demand?

Seemingly every category of product is seeing a jump in ecommerce sales. Research by Signifyd Inc. found significant ecommerce spending in various categories that include alcohol, auto parts, general merchandise, home goods, and more. As ecommerce spending is propelled forward, there are technology implementations that can be considered to enhance the online shopping experience.

Some customers prefer certain experiences at brick-and-mortar stores. For example, hand-selecting things like produce is not possible online. This is an experience many customers desire. In addition, whether in a home goods store or a grocery store, many shoppers peruse isles to discover things they need or want as they shop. With technology, such differences in experience can be bridged. As everyone from young adults to senior citizens turn to online shopping like never before, brick-and-mortar stores need to adapt to serve their needs.

Using 2.5D Modeling to Converge an Experience

To create an online shopping experience that is more like physically being there, developers can use 2.5D modeling. Briefly, we understand two-dimensional, or 2D, things to be flat. This is much like a drawing on a paper or text on your computer screen. Everything is pretty much at the same depth.

When something is three-dimensional, or 3D, it is thought of as having three axes or three planes of depth. With a 3D view, you can pretty much rotate an entire item to see all its sides. So, we can see how 2.5D modeling might be somewhere in between.

With 2.5D modeling, it is essentially a 2D model with overlays on top to make things appear as if they were three dimensional. You might imagine a 2D picture of a box of macaroni. With a 2.5D model a developer can overlay the side or sides of the box on top of the 2D image giving the impression of depth and providing more product detail. But why not just go all the way and use 3D modeling?

A RETAIL STORE CAN BUILD AN ONLINE STORE WITH 2.5D MODELING TO RESEMBLE A PHYSICAL STORE EXPERIENCE IN THE VIRTUAL REALM FOR ONLINE SHOPPING.

To build an online store with 3D modeling would be prohibitive in at least two ways. First, 3D imagery requires far more storage and file size. But that is not the concern as much as it is how long it would take for a customer to load a page, let alone many pages. Consumers simply are not willing to wait long enough for it. Second, building a 3D model of an entire store and all its items is also comparatively cost prohibitive.

Implementing Modeling

To create such a 2.5D model of a retail store, one can use a person, robot, or drone to move along the isles of the store. While moving, images are captured of the complete environment. These images can then be stitched together to create the virtual store.

This is much like creating a panorama shot with a camera. To do so, an amateur photographer first shoots the left side of a scene, then the middle, and then the right. With software, the images are then stitched to create one image of the entire scene. This is what a store can do but with many more images to capture the entire store, aisle by aisle. Barcode labels on store shelves can be used to create the main stitching coordinates.

One obstacle will be that when a store changes its product lines or the display and positioning, it will require redoing imagery and re-stitching. Again, this can be made simpler with barcoding. When stitching together images, using barcode price tags on store shelves is ideal. By standardizing these barcodes – their location, barcode type and so on – developers can use software that offers the capability to stitch in this manner, to build their virtual online store more easily.

Adding Augmented Reality

With a 2.5D model stitched together of all isles, produce areas and other product locations, you can consider augmented reality (AR) to spruce up the overall experience. AR is basically where you can further overlay more images, video, audio, haptic feedback, and more on top of the 2.5D model.

One example might be adding AR to a 2.5D model of a box of a throw pillow. When a shopper is in the view of the pillow on a shelf, they can pull it out and view it and perhaps flip it over. An AR overlay might include an informational box listing the materials it is made of. You might even add a haptic feedback of a soft vibration to imply how soft the pillow is. There are many paths to using AR to create a more enriched interactive experience. By adding AR, developers can get one step closer to mirroring an experience of being at a brick-and-mortar store.

BY LAYERING AUGMENTED REALITY ON A 2.5D MODEL OF A RETAIL ITEM, STORES CAN GENERATE NEW LEVELS OF POSITIVE AND DIFFERENTIATED ONLINE SHOPPING EXPERIENCES.

Potential Challenges

There are two clichés that are important here. Image is everything and garbage in, garbage out. Getting good imagery to create the 2.5D virtual environment is important to the overall experience. But the better the quality of an image, the more page loading time will increase. At the same time, the more compressed an image is, the lower the quality will be.

Developers might need to balance these performance requirements against the potential local differences of a customer’s wireless connection performance. In addition, proper stitching of the environment is paramount to technical accuracy. This ensures the images the customer sees are actually for the right location and product, and that they are visually pleasing.

Also, stores would be limited in how often they might want to change product locations or in performing store redesigns. This is of course unless they are willing to also redo the panoramic imagery of the store after it has been changed.

A New Shopping Experience

With good planning, development, and execution, a whole new shopping experience is possible. Now a customer can open their browser, whether on a computer, smartphone, or tablet, and visit the online store with an experience that simulates a real visit. A customer can virtually walk the aisles of the store.

Once they see an item they like, the 2.5D imagery lets them further explore it in a way more like the real world. If they select an item, the intelligent application can be made to register the affiliated nearby barcode for the product to call up pricing and, if desired, inventory details about the product. The AR overlaid will help the customer with additional information or add to an enriched product experience.

Online shopping is changing the face of the retail experience. The pandemic has thrust brick and mortars to more quickly adapt than even before to online shopping. Companies that can more speedily and elegantly adapt to the experience customers want will be best positioned to keep or grow their customer base in a post-pandemic economy.

Amy Gu

Amy Gu is a co-founder of Dynamsoft, a software company focused on software development kits for document imaging, scanning and barcode reader web and desktop applications. Amy holds a Ph.D. in computer science. She was an associate professor at the Artificial Intelligence Institute at Zhejiang University. She was also a visiting scholar at the University of British Columbia and an exchange professor at Simon Fraser University.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

More From Retail Insider

Iconic Flo’s Diner in Toronto’s Yorkville Forced to Close After 33 Years Amid Landlord Dispute 

Retail Insider interviewed Flo’s co-owner who discusses the “heart wrenching” situation where he is being forced to close his business that began on Bellair Street in 1991.

Anatomy of a Leader: Teresa Spinelli, Owner of Alberta-Based Italian Centre Shop Ltd.

Spinelli discusses her leadership of the popular retailer which has expanded over the years, describing how she struggled to run the company at first and grew to love it.

Upscale Canadian Fashion Brand SMYTHE Expands with New Standalone Calgary Store [Interview/Photos]

It's the second store location for the Toronto-based brand, which is seeing success with its exclusive womenswear collections.

Toronto’s CF Sherway Gardens Hits Sales Milestone with Exciting Retail Growth and Future Plans [Interview]

The shopping centre is adding new retailers as sales per square foot hit an all-time high, with plans to re-tenant Nordstorm as foot traffic grows following Eataly's opening in the mall a few months ago.

ECS Coffee Opens Canada’s Largest Coffee and Espresso Equipment Gear Showroom and Retail Space in Toronto [Interview]

The new Etobicoke location is unique to Canada if not North America, according to its founder, with coffee roasting, equipment showroom, over 500 varieties of coffee, Youtube studio and various in-store experiences. He has plans to expand the concept nationally.

New Loblaws City Market Opens in Vancouver’s ‘The Post’ Building, Adding Grocery Competition to the Downtown Core [Podcast]

Craig and Lee discuss the opening of a new Loblaws City Market in downtown Vancouver's renovated Post building, and they explore its potential impact on local grocery shopping.

Loblaw Announces $2 Billion Investment in Canada for 2024 with Dozens of New Stores and 7,500 New Jobs [Expert Comment]

The retail behemoth will be growing substantially this year, following backlash over profits as inflation continues to impact Canadians.

Dubai-Based Asian Street Food Concept ‘Wok Boyz’ Expands into Canada with Plans for Multiple Locations [Interview]

The company's founder says the popular concept, with personalized meals, has an opportunity to grow substantially with its high-quality ingredients and theatrical flare, complete with fiery customer-facing woks.

Calgary Surge Basketball Team Launches Innovative Pop-Up at CF Chinook Centre to Boost Community Engagement [Interview]

The retail activation, which opened this month, is resulting in heavier foot traffic in a quieter part of the mall.

Upscale Pusateri’s Fine Foods to Close Yorkville Grocery Store in Toronto After 20 Years

The 5,500 square foot store opened to much fanfare in 2003, with valet parking, private chefs and pricey goods. 

Loblaw and Walmart Could be Forced to Adhere to Grocery Code of Conduct with Legislation [Op-Ed]

Sylvain Charlebois says that it's rare for all of Canada's political parties to agree, signalling a shift that could force grocers to comply amid record inflation.

Factory Direct to Shut All 14 Stores Amid Bankruptcy, Liquidation to Begin Saturday

The company, founded in 1995, is one of Canada’s largest privately owned discount retailers which struggled with declining sales and increasing costs following the pandemic.

What to Expect for the Canadian Retail and Hospitality Sectors in 2024 [Video Interview]

Michael Kehoe provides an expansive overview of what's expected for Canada's retail industry in 2024, and how the commercial real estate industry is becoming more dynamic than ever.

Anatomy of a Leader: David Lui, CEO of Kit and Ace and Co-Founder of Unity Brands

Lui has an extensive background in retail with over 30 years of experience and is known for his award-winning brand transformations, e-commerce and digital knowledge along with his passion for scaling businesses.

Robotic Retail Gaining Traction in Canada, But Some Consumers are Being Left Behind [Op-Ed]

Automated retailers without in-store staff are opening across Canada, such as Aisle 24, RC Coffee and PizzaForno -- but consumers without smart phones, credit cards, or with vision issues may not be able to access these retailers says a researcher.

Oakridge Park Announces 1st Luxury Retailers, Attracting Top Brands to Vancouver [Podcast]

Craig and Lee discuss the latest Oakridge Park announcement, highlighting the addition of luxury and upper contemporary brands to Vancouver's retail landscape and how it will impact downtown.

Interview on What it Takes: Lee Valley Tools Named Top Retailer in Ontario for Customer Service

The company's COO Jason Tasse discusses the retailer's secret sauce for having an engaged workforce, while also discussing plans to expand with more stores and retail concepts.

Survey Data Shows Canadians will Prioritize Romance Over Budget Cuts This Valentine’s Day [Interviews]

David Litwin of Moneris notes that Valentine's is an interesting bellwether for what businesses might expect from consumers for the rest of the year.

Anine Bing to Open 2nd Canadian Storefront at the Four Seasons Hotel in Toronto 

The US-based women’s fashion brand recently opened its first Canadian store at Yorkdale, and will open its second location in a downtown luxury hotel. 

Retail Burnout Crisis in Canada: The Call for Empathetic Leadership and Proactive Solutions Amid Operational Strains [Feature]

It's never been more difficult to work in retail, with store managers burning out amid lower staffing numbers, increased task and store robberies. Two industry experts discuss the situation.

RECENT RETAIL INSIDER VIDEOS

Advertisment

Subscribe to the Newsletter

Subscribe

* indicates required

RECENT articles

Iconic Flo’s Diner in Toronto’s Yorkville Forced to Close After 33 Years Amid Landlord Dispute 

Retail Insider interviewed Flo’s co-owner who discusses the “heart wrenching” situation where he is being forced to close his business that began on Bellair Street in 1991.

Anatomy of a Leader: Teresa Spinelli, Owner of Alberta-Based Italian Centre Shop Ltd.

Spinelli discusses her leadership of the popular retailer which has expanded over the years, describing how she struggled to run the company at first and grew to love it.

Upscale Canadian Fashion Brand SMYTHE Expands with New Standalone Calgary Store [Interview/Photos]

It's the second store location for the Toronto-based brand, which is seeing success with its exclusive womenswear collections.

Toronto’s CF Sherway Gardens Hits Sales Milestone with Exciting Retail Growth and Future Plans [Interview]

The shopping centre is adding new retailers as sales per square foot hit an all-time high, with plans to re-tenant Nordstorm as foot traffic grows following Eataly's opening in the mall a few months ago.

ECS Coffee Opens Canada’s Largest Coffee and Espresso Equipment Gear Showroom and Retail Space in Toronto [Interview]

The new Etobicoke location is unique to Canada if not North America, according to its founder, with coffee roasting, equipment showroom, over 500 varieties of coffee, Youtube studio and various in-store experiences. He has plans to expand the concept nationally.

New Loblaws City Market Opens in Vancouver’s ‘The Post’ Building, Adding Grocery Competition to the Downtown Core [Podcast]

Craig and Lee discuss the opening of a new Loblaws City Market in downtown Vancouver's renovated Post building, and they explore its potential impact on local grocery shopping.

Loblaw Announces $2 Billion Investment in Canada for 2024 with Dozens of New Stores and 7,500 New Jobs [Expert Comment]

The retail behemoth will be growing substantially this year, following backlash over profits as inflation continues to impact Canadians.

Dubai-Based Asian Street Food Concept ‘Wok Boyz’ Expands into Canada with Plans for Multiple Locations [Interview]

The company's founder says the popular concept, with personalized meals, has an opportunity to grow substantially with its high-quality ingredients and theatrical flare, complete with fiery customer-facing woks.

Calgary Surge Basketball Team Launches Innovative Pop-Up at CF Chinook Centre to Boost Community Engagement [Interview]

The retail activation, which opened this month, is resulting in heavier foot traffic in a quieter part of the mall.

Upscale Pusateri’s Fine Foods to Close Yorkville Grocery Store in Toronto After 20 Years

The 5,500 square foot store opened to much fanfare in 2003, with valet parking, private chefs and pricey goods. 

Loblaw and Walmart Could be Forced to Adhere to Grocery Code of Conduct with Legislation [Op-Ed]

Sylvain Charlebois says that it's rare for all of Canada's political parties to agree, signalling a shift that could force grocers to comply amid record inflation.

Factory Direct to Shut All 14 Stores Amid Bankruptcy, Liquidation to Begin Saturday

The company, founded in 1995, is one of Canada’s largest privately owned discount retailers which struggled with declining sales and increasing costs following the pandemic.

What to Expect for the Canadian Retail and Hospitality Sectors in 2024 [Video Interview]

Michael Kehoe provides an expansive overview of what's expected for Canada's retail industry in 2024, and how the commercial real estate industry is becoming more dynamic than ever.

Anatomy of a Leader: David Lui, CEO of Kit and Ace and Co-Founder of Unity Brands

Lui has an extensive background in retail with over 30 years of experience and is known for his award-winning brand transformations, e-commerce and digital knowledge along with his passion for scaling businesses.

Robotic Retail Gaining Traction in Canada, But Some Consumers are Being Left Behind [Op-Ed]

Automated retailers without in-store staff are opening across Canada, such as Aisle 24, RC Coffee and PizzaForno -- but consumers without smart phones, credit cards, or with vision issues may not be able to access these retailers says a researcher.

Oakridge Park Announces 1st Luxury Retailers, Attracting Top Brands to Vancouver [Podcast]

Craig and Lee discuss the latest Oakridge Park announcement, highlighting the addition of luxury and upper contemporary brands to Vancouver's retail landscape and how it will impact downtown.

Interview on What it Takes: Lee Valley Tools Named Top Retailer in Ontario for Customer Service

The company's COO Jason Tasse discusses the retailer's secret sauce for having an engaged workforce, while also discussing plans to expand with more stores and retail concepts.

Survey Data Shows Canadians will Prioritize Romance Over Budget Cuts This Valentine’s Day [Interviews]

David Litwin of Moneris notes that Valentine's is an interesting bellwether for what businesses might expect from consumers for the rest of the year.

Anine Bing to Open 2nd Canadian Storefront at the Four Seasons Hotel in Toronto 

The US-based women’s fashion brand recently opened its first Canadian store at Yorkdale, and will open its second location in a downtown luxury hotel. 

Retail Burnout Crisis in Canada: The Call for Empathetic Leadership and Proactive Solutions Amid Operational Strains [Feature]

It's never been more difficult to work in retail, with store managers burning out amid lower staffing numbers, increased task and store robberies. Two industry experts discuss the situation.