Have you ever tried searching for a product on your favorite online shopping site, only to be disappointed when you couldn’t find the product that you’re looking for? Most product site search engines leverage accurate product categorization attributes to help narrow the search results for a user.

In this article we’re going to look at the impact that proper categorization has on search and how it’s now possible to automate product categorization with a machine learning model.

Categorization starts with a well designed product category taxonomy. The product taxonomy defines how each product type is related. The first couple levels of a product taxonomy contain broad category labels. For a grocery taxonomy, the top levels might be organized by departments within the store. It’s a logical representation of the way that a shopper would look for a given product in the physical store. A taxonomy is often referred to as a “Product tree”, with each product category referred to as a “branch” and each individual item referred to as a “leaf” on that branch.

Grocery taxonomy example:

1. Meat & Seafood

1. Fresh Meat

1. Ribs

2. Smoked Ham

3. Specialty Meat

4. Kosher Meat

5. ...

2. Fresh Seafood

3. Packaged Meat

4. Packaged Seafood

2. Produce

3. Deli

4. Bakery

5. Adult Beverages

6. Beverages

7. Floral

8. ...

For a new product to be put into the online product catalog, it first needs to be categorized appropriately into the correct level of the product taxonomy. This is easy enough for a human to complete the product categorization, however, when you have thousands and thousands of products, this can be a tedious process.

The science of search has evolved over the last two decades. Trying to determine the searchers intent from one or two words is not a simple process. We’re not going to dive into that in this article. However, in the specific use case of product search for an ecommerce website, most shoppers will generally include the object of their intent as part of the search input. In most cases this data can be used to quickly narrow the results set based on the product taxonomy. After all, the consumer isn’t looking for organic lettuce in the seafood section, nor would they be looking for seafood in the produce section. So one method to quickly close the search breadth is to narrow the search to specific sub-branch of the product taxonomy.

One downside to improper categorization is that improperly categorized products can become “lost”. When a product is mis-categorized on an improper branch of the taxonomy, the search engine may either (1) not find the product or (2) relegate the mis-categorized product to the bottom of the search results.

Don’t believe me? Try this: go to your favorite ecommerce provider, search for something, and then go to the last page of the search results. What do find there? Don’t let this happen to your product catalog.

In addition, the product category for a given catalog item can help define the product schema that should be employed to display the product information for the consumer on the product data page. The schema can also help define the meaning of generic product attributes, depending on the product type.

ATOM is the product categorization service from IceCream Labs. We developed ATOM as an API service which can be accessed automatically from your product information manager. ATOM takes a product title or description as an input and outputs the recommended product category for the item. ATOM is powered by a machine learning model that has been trained on millions of product records. It’s constantly learning as it processes new data.

With ATOM, you can properly categorize or validate a new product item before accepting it into your production product catalog.

To learn more about ATOM, or see a demo, contact our sales team: sales@icecreamlabs.com

PHOTO CREDIT: Photo by Min An from Pexels

Retail is changing at lightning speed and as we move towards the end of the year, as consumers begin anticipating what their shopping experience will look like in 2019. Retailers continue to evolve in a highly competitive world where delivery, customer experience, and convenience are the main factors that seal the fate of any store - forcing some into bankruptcy and propelling some into profits.

Here are five things to look forward to in retail next year, and most of them include technology:

More online grocery shopping

Despite having a small portion of consumers using online grocery shopping, industry experts expect digital sales to reach 20 percent of the total grocery market by 2025. Many retailers are partnering with third-party delivery companies such as Shipt and Instacart, enabling many consumers to order groceries from anywhere in a click or tap of a button. Soon, consumers will increasingly order online.

This includes both delivery and ordering online to pick up in store. It’s also expected that social media platforms like Instagram will continue discovering new ways to convince consumers to buy online.

Voice Retail

Experts say shoppers will increasingly pick up voice shopping through smartphones, Amazon devices, and vehicles.

Consumers with Alexa-enabled devices are already able to purchase their groceries, home goods, and gifts through Amazon and Whole Foods Market. But other retailers are starting to get in on the action.

Kroger recently announced plans to roll out voice ordering through Alexa-enabled devices and Amazon has released software that allows developers to integrate Alexa in vehicle infotainment systems.

More private labels

 Private labels have proven successful in the eyes of consumers this year. Dozens of retailers including Target, Kroger, Walmart, Aldi, and Amazon have expanded private label offerings this year.

Private labels are notorious for adding exclusivity that builds customer loyalty, all while keeping profit margins high without suppliers taking their cuts. Many of the retailers have passed the savings to the consumer with low-cost private labels that are increasingly growing in popularity.

Growth in artificial intelligence

Retailers have used artificial intelligence to learn consumer and market habits. The technology becomes increasingly beneficial for online retailers looking to upsell without a physical salesperson. Different subscription services like Stitch Fix and Kidbox have used AI to analyze subscriber data to recommend products that increase relevance and are more likely to be purchased.

Retailers are trying to use AI to expand holiday shopping earlier as well, learning what consumers will want most around the holidays as early in the year as possible. The intelligence can help spread out orders so delivery systems won’t become as congested close to the holidays.

More interactive aisles

As consumer shopping habits shift to favor experience, retailers are scrambling to find ways to draw crowds into stores. In 2019, augmented reality and virtual reality are likely to take a stronger foothold in all types of brick-and-mortar stores.

 For example, Kettering-based Marxent has developed augmented reality technology for Macy’s to show how furniture could look without having to purchase the items.

Leveraging AI and Machine Learning for Product Matching

There is a vast number of products sold online through various outlets all over the world. Identifying, matching and cross-checking products for purposes such as price comparison becomes a challenge as there are no global unique identifiers.

There are many situations where accurately identifying a product match is essential. For instance, stores may want to compare competitor prices for the same product they may offer. Similarly, customers may use comparison tools to get the best deals. Amazon allows different sellers to offer the same products only after ensuring that they are the same before listing the sellers in a single, unique product page.

Numerous products but no method to match them across different stores

Product titles/descriptions do not have a standardized format. Each store, as well as different sellers within a store, might have different titles and descriptions for the same products. Another challenge comes in with respect to attribute listings as different e-tailers follow different formats. The product images of the same product also differ across different e-tailers.

While there are standardized unique identifiers like UPC, MPN, GTIN, etc, they, however, may not be mentioned in the product page in all stores selling them. The attributes themselves may be described differently - for instance 9" and 9 inches. Images may be included but they can differ in perspective, clarity, tone, etc. The brand name may also be referred to in different ways like GE and General Electric.

<image>

It is an impossible task for a human to visit different product pages to ensure if they are matching the same products. Although, if the process is to be automated, how can it be ensured that the system makes sense of all the information. This is when AI and machine learning come into the picture. 

Machine Learning for Product Matching

In machine learning solutions for product matching, the solution provider must initially build a database with billions of products. This can be done by collecting information through web crawls and feeds. The system then has to come up with a universal taxonomy. This especially is a unique challenge as different retailers use different classifications for their products, and the same product might be listed in more than one category. For instance, a particular shoe model might be listed under casual shoes as well as dress shoes. The system first must design a standardized taxonomy, irrespective of how a particular store classifies its products.

There are standard classification models such as Google Taxonomy, GS1, and Amazon but a product match solution may devise its own taxonomy. The universal taxonomy is designed by identifying patterns and signals from titles, product descriptions and attributes, and from images.

Once a universal taxonomy is in place, the next step is making particular product matches. Here, there is a need for precise comparisons to ensure a particular product is indeed the same unique product, despite the differences in titles, images, descriptions, etc. First, there is a search for unique identifiers such as UPC or GTIN on the product page. Then, the product titles need to be compared. It needs to be noted that no two product titles are the same across different stores for the same product, for example:

Neural networks play a key role

Neural networks and deep learning techniques are extensively used to identify and learn from similarities, to identify and learn from differences, and produce word-level embedding to create a system of representation for common words. This involves teaching the system to recognize different references to a unique entity such as 'GE' and General Electric or 7" or 7 inches, to come up with one unique representation for each entity.

A product can be identified using its title, description, images and attributes or its specifications list. In many cases, the product title itself will yield a lot of information and the system needs to be trained to differentiate the product name (for instance, brand model) from the attributes.

<Phone model images>Samsung Galaxy Note 8 (US Version) Factory Unlocked Phone 64GB – Midnight Black (Certified Refurbished)Samsung Galaxy Note 8 is the phone model, and the title provides additional information like the memory size, US version, Factory Unlocked Refurbished, etc. 

Identifying and sorting product matches 

The information then needs to be extracted and sorted into the appropriate slots - Phone model, version, memory size, etc. Different techniques might be used to help the system learn to parse and sort the different sets of information. 

The next comparison comes in the form of more information about the product such as the title, description containing additional information and a specs table. These help add more knowledge about the product, and the machine will be better able to identify an exact product match or mismatch in the following comparison.

The standard identifying signals are similar results or positive matches for unique identification numbers (UPC or MPN), classification, brand, title, attributes, and image. For each comparison, the system follows a long procedure of checks or safety valves. The checks pass through a search for the unique identification number, a test for keyword similarities, brand normalization and match (for example, HP is the same as Hewlett Packard), attribute normalization and match ( 9 inches is the same as 9in, 9"), image matching, etc. There is also a check for variation in attributes such as:

For the best product match result, there has to be at least 99% of positive results. It will be considered a mismatch, even if it is a variation of what is essentially the same product. Different product match solutions employ different techniques and training methods, and it is a complicated process. Although, there is an advantage that neural networks and machine learning learn over time, and get better with each use.

E-commerce requires awesome product data to support successful search and conversion. Product data for the online grocery market is currently being created manually. Retailers are struggling to acquire the rich product data necessary to support their online needs. Brands are struggling to generate good data.

IceCream Labs CatalogIQ is designed to automatically extract attributes from product images. Using either label mechanicals or actual product images of the packaging, CatalogIQ can extract text from the labels. From there, the artificial intelligence in CatalogIQ understands what the text is and inserts it into the appropriate product attribute. The AI can also determine which images are the hero image, and front, back and side images.

CatalogIQ identifies brand names, sub brands and variants, normalizing the brand to the appropriate text. titles are generated from various attributes to create an SEO-rich title to optimize search. Other key attributes include feature/benefits, ingredients and nutrition facts.

CatalogIQ can score the data to help the merchandising and ecommerce teams understand which product records have been enhanced.

• Missing attributes
• Accuracy of attributes (are all of the attributes congruent?)
• How unique are the attributes?
• Is your product record SEO optimized?
• Do you have relevant search keywords?
• How well does your product data match up to customer site searches?

Grocery merchandising teams have the chore of uploading new catalogs from suppliers and manufacturers. Often this data arrives in the form of a spreadsheet. CatalogIQ can easily upload a new catalog file (in spreadsheet form) to quickly and easily complete the ingestion process.

Grocery retailer and channel partners expect high quality product data to list and sell your products online. Can you deliver the content?

CatalogIQ allows brand and product managers to auto-generate high quality product data directly from product label mechanicals and/or product images. If you're currently using manual processes to create product content and to check the accuracy of product data, then let CatalogIQ help you automate the creation process. You'll be able to complete the data creation process much faster than manual methods. CatalogIQ can also validate the content and ensure that it matches what is contained on all of the product labeling.

As a merchandising manager with a large product catalog, you know the difficulties of reviewing your product data and ensuring that everything in the catalog is ready to publish live to customers. There is always the nagging concern that something is inaccurate or missing when you push the “publish” button. Every time that you receive new data from your suppliers, it’s a chore to process the data. You have a long checklist to complete before you can publish data to the live catalog. Processing this checklist can consume all of your time.

People have increasingly become comfortable using technologies such as AI and machine learning in their day-to-day lives. Various companies also have increased their use of AI and machine learning into their product offerings as well as their processes. With the computer processing technology advancing increasingly, companies, institutions and even governments are gathering massive amounts of data as more consumer interactions move towards digital. This type of technology is already transforming the payments landscape in the following aspects -

Improving Efficiency

AI and machine learning have the potential to revolutionize the way payments are processed by enhancing operational efficiency and decreasing costs involved. For instance, AI enabled chatbots are reducing the load for customer service representatives.

With machine learning being incorporated into payments, learning algorithms play an important in helping speed along authorization of transactions and monitoring.
Furthermore, AI helps reduce the processing time for payments. It also helps eliminate human error and save time for correcting those mistakes.

For a business, processing large amounts of data to generate financial reports to satisfy regulatory and compliance requirements would involve a team that would perform repetitive data processing tasks. Leveraging AI would involve training the models to do these tasks, and the model can ensure completing the tasks faster and more accurately than humans. These technologies can improve efficiency while gathering important user insights in real-time.

Machine learning has already proved to be an invaluable part of fraud detection, but there are many opportunities that lie in product sales, customer care, and retention. Machine learning can draw vast amounts of available data and utilize it to profile customers to guess their product needs while offering new opportunities for upselling.

This model can also help identify which customers that companies are at risk for losing as well as halt customer loss before it happens. Machine learning can help automate many customer service interactions. This model which uses deep insights, cognitive engines and natural language processing is already widely available and the usage will only grow with time.

Fraud Prevention

​There are various methods for customers to make payments today. They are no longer limited to paying with cash or even cards. There are new payment methods on the rise such as card-not-present (CNP) transactions, but as it gets popular come new opportunities for fraud. AI and machine learning are at the forefront of not only detecting fraud but also preventing it before it happens.

These technologies already have the capability to uncover patterns and drive hidden insights and are working towards fine-tuning these insights. Companies are choosing to move away from a static model where the reliance is on supervised learning with input towards unsupervised learning wherein the deep belief neural network does not require a labeled training set, but continuously updates the model as new patterns emerge, allowing for a more robust and flexible fraud prevention detection tool.

As more commerce and payments move online, more data is accessible. This new robust algorithm uses machine learning to decrease the false positives and more agile detection of the actual frauds.

AI and machine learning have come a long way in the past decade. These technologies have already been adopted by many sectors and have transformed many aspects of traditional processes. Though exciting new technologies have been adopted by businesses to improve and enhance the payment process and customer experiences, the scope for future implementation is endless.

The retail experience of a shopper is the latest area that AI and machine learning are causing disruption. Most retailers recognizing the potential of these technologies have started aligning them into their business goals. Two crucial aspects - data and computing power have changed in the past few years in the space of AI, which has opened up new opportunities for retailers today.

Computing power is easy to see, with the advent and rise of smartphones which have phenomenal computing power when compared to the bulky phones and computers used decades ago. Businesses today have unlimited computing access to train their AI algorithms. Furthermore, the data available today is extremely rich and scalable. AI systems that leverage learning techniques such as Machine learning thrive on large, rich data sets. When fed appropriately, these systems discover patterns and correlations that would be otherwise difficult with a human intervention. These machine learning approaches automate data analysis, enabling users to create models that can then be used to make useful predictions about other similar data.

The speed at which AI can be deployed depends on specific critical factors. The first is the ability to test and measure. Retail giants can effectively deploy AI and test and measure consumer response. They can also leverage AI to measure the effect on their entire supply chain.

There is some innovative and interesting robot technology taking place in retail such as Grocery giant partnering with Nuro.AI to deliver groceries to the customers’ doorsteps. But most significant changes will come from the deployment of AI rather than the use of physical robots or autonomous vehicles.

Here are 3 AI-based scenarios that will transform the retail experience -

AI can detect underlying patterns in the shopping behavior of shoppers from the products that they buy and the method used to buy them. This could be a simple weekly purchase of groceries from the supermarket, the sporadic purchases of wine from the liquor store or the complex midnight icecream cravings from the local convenience store.

At a larger scale, analysis of the behavior of millions of consumers would enable supermarkets to predict the number of households that cook pasta every week. This would then inform the inventory management systems, and automatically optimize the stock of pasta. This information can also be shared with the suppliers, enabling more efficient inventory management and organized logistics.

The pricing challenge for supermarkets involves applying the right price and the right promotion to the right product. Retail pricing optimization requires data analysis at a granular level for each customer, product and transaction. To be effective, many factors need to be considered such as the impact of sales due to the changing price over time, seasonality, weather and competitors’ promotions.

A well-defined machine learning program can factor in all variations, including details such as purchase histories and product preferences to develop deep insights and pricing tailored to maximize revenue and ultimately, profit.

In the past, customer feedback was collected through forms and feedback cards that were filled out and placed in a suggestions box. The feedback had to be manually read and acted upon appropriately. With the rise of social media, the platforms were leveraged to express feedback publicly. Retailers subsequently engaged in social media scraping software to respond, resolve and engage with customers.

With the growing innovations, machine learning will play a larger role in this space. Machine learning and AI systems will be able to analyze unstructured data from multiple sources such as verbal comments or video content.  

The evolving retail experience

As a shopper moves through various stages in life, the circumstances and spending habits change. AI and machine learning models will adjust and be able to predict the needs of the consumer before the consumer even searches for a product.

This shift to predictive marketing would change the way shoppers purchase products, bringing in suggestions and recommendations that they would not have even considered. The possibilities would widen, all because of AI - for both consumers and retailers alike.

With the growing popularity of image-based social media platforms like Instagram and Snapchat, there has been a significant rise in UGC (user-generated content) on the internet. Users upload photos not only of their lives but also of interactions with different products or brands they encounter online. Retailers and brands can leverage this information to engage and interact with users building brand awareness. However, with the increased use of UGC, it has become a challenge for them to track and categorize unstructured information. This challenge can be addressed using image recognition and computer vision.

Helping with Product Search

If a user while looking for a type of furniture is unable to use the right terms to describe the item in the search query, he/she could always depend on voice assistants such as Alexa, Siri or Google Home. However, the voice command is really just fulfilling a text query.

Instead, by taking a few pictures of the object and uploading it online using image search, the user can find what he/she is looking for. Using image-based AI, the search breaks down different elements of the image and enables the user to choose which aspects of the results are important.

For instance, there is a beautiful couch in the living room but it is missing a coffee table. The user can take a picture of the couch and upload it as a search item. The image AI picks up on the couch and detects the elements such as color palette, wooden legs, etc. It then provides results of coffee tables that can match and complement these elements. Furthermore, based on its database, the AI can also recognize elements such as the brand, price range, etc. of the couch allowing the AI understand what type of budget the user may be willing to spend on furniture items. This goes beyond the simple search that people see today. 

Personalized experience on social media

Social media is empowered by AI, and brands and retailers can now detect and analyze every mention on the social media platforms using image recognition. They can also view how the brand is portrayed through the various images and videos shared on a daily basis. This further allows brands to interact with the users as well as collect and reshare their images helping the users to develop a personal connection with the brand.

Brands are also leveraging computer vision to provide a more targeted ad experience for users. For example, after browsing through an Instagram feed of a famous fashion celebrity, the user may get ads of fashion lookbooks featuring some of the pieces worn by that celebrity. These type of ads provide a subtle recognition for the user, which in turn helps brands build awareness and engagement.

AI in video content

For video content, brands and retailers can use AI to scan the video and index objects, scenes and audio sounds such as a dress from a popular brand or a painting from a famous artist or a song from a famous musician. Leveraging these elements, brands can then promote their products that can relate to these items such as bags that may match the dress in the video.

For video advertisements, brands can insert their products into a “placeholder” dynamically. Video producers can mark areas in their videos that can easily incorporate an inserted image and depending on the geography, language, and demographic segregation of the audience, AI can dynamically insert an ad into the video. This personalized approach enables a more local advertising experience for the users.

The e-commerce landscape is evolving with technological innovations changing the way people shop online. Images and videos are a largely untapped resource for retailers and brands to get insights from but with image recognition and computer vision gaining momentum, it is now possible. Giants like Amazon have also recognized its potential and have incorporated image-based search into their shopping experience. The applications for AI in images and videos are still limited but with deep learning, it is evolving and has the potential to change the shopping experience completely.

With online sales growing faster and the e-commerce landscape changing with technological innovations, traditional retailers are increasingly investing in omnichannel strategies and doubling their efforts in order to meet consumer demands. An effective way to keep pace with e-commerce giants and stay relevant in the marketplace is to offer high-grade product discovery and selection. This requires providing detailed product content with product-specific attributes, along with semantic search.

The current product content problem

As more retail businesses are moving towards e-commerce, the need for quality information and powerful search platforms has become crucial in order to entice shoppers and help them make effective purchase decisions. However, this is a challenge as they are unable to easily deliver complete product content.

Retailers rely on the suppliers to provide all the coordinating images, videos, attributes, etc. for each of the products. Suppliers use various methods to provide content such as printed or digital catalogs or in different formats like Excel, PDF, etc., making it difficult for retailers to properly source and extract the right data required for the right product. In some cases, retailers even purchase content from third-party providers or online databases. However, the challenge here persists, as most of the time, content differs from suppliers to third-party providers and validation of the information becomes tedious.

Besides the price of a product, detailed product information along with superior quality-images, videos play an important role in a consumer’s buying decision. 

There are numerous technological challenges while extracting content from the product images - some including region segmentation, diverse product backgrounds, natural settings, typography and fonts, lighting conditions, and low-quality images. For instance, inconsistent product image sizes would limit the system to capture the product details completely from all the images.

Impact of poor quality data

Missing information and uncertainty are two leading factors for consumers to abandon their shopping journey. Consumers tend to leave their shopping journey when they sense that the product does not have clear or complete information. This could range from unclear product descriptions to missing or inaccurate product attributes such as size, materials used, ingredients, etc. or even product reviews.

While there is no definitive rule stating an optimal number of product images or videos or a recommended character limit for product information, the quality of product images and videos have a direct impact on the ability of the e-commerce business to generate sales. With complete and comprehensive product information (description along with attributes like size, or weight, etc.) and high-quality images and videos would enable shoppers with the information they may need to make a purchase decision.

Effective Extraction of Product Content

With IceCream Labs CatalogIQ, retailers can effectively address the problems they face while onboarding product content to their catalogs. Leveraging machine learning algorithms, Optical Character Recognition (OCR) systems, and Natural Language Processing (NLP) techniques, it can effectively extract the right information needed for the retailer to optimize their content as well as maintain their content health. Some of its capabilities include:

Attribute Extraction: ​

Images would be clicked from all angles of the product and would be fed into the machine. Leveraging NLP techniques, brand attributes such as brand name, sub-brand, tagline, flavor, net weight/volume, and calorie information would be extracted.

Brand Name Detection (Logo detection): 

Leveraging OCR, the product image is scanned for text and the output is further sent to an NLP engine specifically to identify text logos (ex: for brand logos like Zara). If the text is not detected, image processing is further applied using the brand name parameters (ex: for brand logos like Nike)

Standard Certification Detection:

In this step, a preset database with standard food certification parameters is applied to detect and extract food certification labels such as “gluten-free”, “non-GMO”, “100% organic”. Here, the images are scanned using these parameters. This is similar to how the Brand Name detection functions.

Nutrition Facts Extraction:

Using OCR and region segmentation, nutritional facts text is extracted. This text is further corrected using a predefined vocabulary to streamline the content. A rule-based approach is then applied to the corrected text to extract nutritional values.

Product label images are a trusted source of product information for consumers. AI can ensure that the process would improve the quality of the information and maintain data consistency across all product pages. Retailers can further benefit from this as it would alleviate the burden of validating product data provided by various suppliers, online databases or third-party providers and can provide additional information that is critical for product discovery like brand or certification logo information.

The future of Product content

Applications leveraging AI and machine learning have projected tremendous potential for applying process automation to reduce data inconsistency and enhancing data quality and thereby, improving the product data extraction processes.

At IceCream Labs, we strive to address the challenges that businesses face in e-commerce using AI and machine learning. Are you ready to enhance your product content and take your e-commerce business to the next level? Reach out to us at sales@icecreamlabs.com for an AI-based solution for your business.

​