Try : Insurtech, Application Development

AgriTech(1)

Augmented Reality(21)

Clean Tech(9)

Customer Journey(17)

Design(45)

Solar Industry(8)

User Experience(68)

Edtech(10)

Events(34)

HR Tech(3)

Interviews(10)

Life@mantra(11)

Logistics(6)

Manufacturing(4)

Strategy(18)

Testing(9)

Android(48)

Backend(32)

Dev Ops(11)

Enterprise Solution(33)

Technology Modernization(9)

Frontend(29)

iOS(43)

Javascript(15)

AI in Insurance(41)

Insurtech(67)

Product Innovation(59)

Solutions(22)

E-health(12)

HealthTech(25)

mHealth(5)

Telehealth Care(4)

Telemedicine(5)

Artificial Intelligence(154)

Bitcoin(8)

Blockchain(19)

Cognitive Computing(8)

Computer Vision(8)

Data Science(23)

FinTech(51)

Banking(7)

Intelligent Automation(27)

Machine Learning(48)

Natural Language Processing(14)

expand Menu Filters

How we used RetinaNet for dense shape detection in live imagery

Convolutional Neural Networks (CNN) have come a long way in conveniently identifying objects in images and videos. Networks like VGG19, ResNet, YOLO, SSD, R-CNN, DensepathNet, DualNet, Xception, Inception, PolyNet, MobileNet, and many more have evolved over time. Their range of applications lies in detecting space availability in a parking lot, satellite image analysis to track ships and agricultural output, radiology, people count, detecting words in vehicle license plates and storefronts, circuits/machinery fault analysis, medical diagnosis, etc.

Facebook AI Research (FAIR) has recently published RetinaNet architecture which uses Feature Pyramid Network (FPN) with ResNet. This architecture demonstrates higher accuracy in situations where speed is not really important. RetinaNet is built on top of FPN using ResNet.

Comparing tradeoff between speed and accuracy of different CNNs

Google offers benchmark comparison to calculate tradeoff between speed and accuracy of various networks using MS COCO dataset to train the models in TensorFlow. It gives us a benchmark to understand the best model that provides a balance between speed and accuracy. According to researchers, Faster R-CNN is more accurate, whereas R-FCN and FCN show better inference time (i.e. their speed is higher). Inception and ResNet are implementations of Faster R-CNN. MobileNet is an implementation of SSD.

Faster R-CNN implementations show an overall mAP (mean average precision) of around 30, which is highest for feature extraction. And, at the same time, its accuracy is also highest at around 80.5%. MobileNet R-FCN implementation has a lower mAP of around 15. Therefore, its accuracy drops down to about 71.5%. 

Thus, we can say — SSD implementations work best for detecting larger objects whereas, Faster R-CNN and R-FCN are better at detecting small objects.

speed and accuracy of various CNNs

On the COCO dataset, Faster R-CNN has average mAP for IoU (intersection-over-union) from 0.5 to 0.95 (mAP@[0.5, 0.95]) as 21.9% . R-FCN has mAP of 31.5% . SSD300 and SSD512 have mAPs of 23.2 and 26.8 respectively . YOLO-V2 is at 21.6% whereas YOLO-V3 is at 33% . FPN delivers 33.9% . RetinaNet stands highest at 40.8%.

RetinaNet- AP vs speed comparison
The two variations of RetinaNet are compared above for AP vs speed (ms) for inference.

One-stage detector vs two-stage detectors for shape detection

A One-stage detector scans for candidate objects sampled for around 100000 locations in the image that densely covers the spatial extent. This does not let the class balance between background and foreground. 

A Two-stage detector first narrows down the number of candidate objects on up to 2000 locations and separates them from the background in the first stage. It then classifies each candidate object in the second stage, thus managing the class balance. But, because of the smaller number of locations in the sample, many objects might escape detection. 

Faster R-CNN is an implementation of the two-stage detector. RetinaNet, an implementation of one stage detector addresses this class imbalance and efficiently detects all objects.

Focal Loss: a new loss function

This function focuses on training on hard negatives. It is defined as-

focal loss function

Where,

focal loss function

and p = sigmoid output score.

The greeks are hyperparameters.


When a sample classification is inappropriate and pₜ is small, it does not affect the loss. Gamma is a focusing parameter and adjusts the rate at which the easy samples are down-weighted. Samples get down-weighted when their classification is inappropriate and pₜ is close to 1. When gamma is 0, the focal loss is close to the cross-entropy loss. Upon increasing gamma, the effect of modulating factor also increases.

RetinaNet Backbone

The new loss function called Focal loss increases the accuracy significantly. Essentially it is a one-stage detector Feature Pyramid Network with Focal loss replacing the cross-entropy loss. 

Hard negative mining in a single shot detector and Faster R-CNN addresses the class imbalance by downsampling the dominant samples. On the contrary, RetinaNet addresses it by changing the weights in the loss function. The following diagram explains the architecture.

RetinaNet architecture

Here, deep feature extraction uses ResNet. Using FPN on top of ResNet further helps in constructing a multi-scale feature pyramid from a single resolution image. FPN is fast to compute and works efficiently on multiscale.

Results

We used ResNet50-FPN pre-trained on MS COCO to identify humans in the photo. The threshold is set above a score of 0.5. The following images show the result with markings and confidence values.

Dense shape detection
Human shape detection

We further tried to detect other objects like chairs.

RetinaNet object detection

Conclusion: It’s great to know that training on the COCO dataset can detect objects from unknown scenes. The object detection in the scenes took 5-7 seconds. So far, we have put filters of human or chair in results. RetinaNet can detect all the identifiable objects in the scene.

Multiple objects detection using RetinaNet

The different objects detected with their score are listed below-

human0.74903154
human0.7123633
laptop0.69287986
human0.68936586
bottle0.67716646
human0.66410005
human0.5968385
chair0.5855772
human0.5802317
bottle0.5792091
chair0.5783555
chair0.538948
human0.52267283

Next, we will be interested in working on a model good in detecting objects in the larger depth of the image, which the current ResNet50-FPN could not do.

About author: Harsh Vardhan is a Tech Lead in the Development Department of Mantra Labs. He is integral to AI-based development and deployment of projects at Mantra Labs.

General FAQs

What is RetinaNet?

RetinaNet is a type of CNN (Convolutional Neural Network) architecture published by Facebook AI Research also known as FAIR. It uses the Feature Pyramid Network (FPN) with ResNet. RetinaNet is widely used for detecting objects in live imagery (real-time monitoring systems). This architecture demonstrates a high-level of accuracy, but with a little compromise in speed. In the experiment we conducted, it took 5-7 seconds for object detection in live scenes.Dense shape detection - RetinaNet

What is RetinaNet Model?

RetinaNet model comprises of a backbone network and two task-specific sub-networks. The backbone network is a Feature Pyramid Network (FPN) built on ResNet. It is responsible for computing a convolution feature (object) from the input imagery. The two subnetworks are responsible for the classification and box regression, i.e. one subnet predicts the possibility of the object being present at a particular spatial location and the other subnetwork outputs the object location for the anchor box.

What is Focal Loss?

The focal loss function focuses on training on hard negatives. In other words, the focal loss function is an algorithm for improving Average Precision (AP) in single-stage object detectors. It is defined as-RetinaNet focal loss function

What is SSD Network?

Single Shot Detector (SSD) can detect multiple objects in an image in a single shot, hence the name. 
The beauty of SSD networks is that it predicts the boundaries itself and has no assigned region proposal network. SSD networks can predict the boundary boxes and classes from feature maps in just one pass by using small convolutional filters.

Glossary of Terms related to convolutional neural networks

CNN

Deep Learning uses Convolutional neural networks (CNN) for analyzing visual imagery. It consists of an input and output layer and multiple intermediate layers. In CNN programming, the input is called a tensor, which is usually an image or a video frame. It passes through the convolutional layer forming an abstract feature map identifying different shapes.

R-CNN

The process of combining region proposals with CNN is called as R-CNN. Region proposals are the smaller parts of the original image that have a probability of containing the desired shape/object. The R-CNN algorithm creates several region proposals and each of them goes to the CNN network for better dense shape detection.

ResNet

Residual Neural Network (ResNet) utilizes skip connections to jump over some layers. Classical CNNs do not perform when the depth of the network increases beyond a certain threshold. Most of the ResNet models are implemented with double or triple layer skips with batch normalization in between. ResNet helps in the training of deeper networks.

YOLO

You only look once (YOLO) is a real-time object detection system. It is faster than most other neural networks for detecting shapes and objects. Unlike other systems, it applies neural network functions to the entire image, optimizing the detection performance.

FAIR

It is Facebook’s AI Research arm for understanding the nature of intelligence and creating intelligent machines. The main research areas at FAIR include Computer Vision, Conversational AI, Integrity, Natural Language Processing, Ranking and Recommendations, System Research, Theory, Speech & Audio, and Human & Machine Intelligence.

FPN

Feature Pyramid Network (FPN) is a feature extractor designed for achieving speed and accuracy in detecting objects or shapes. It generates multiple feature map layers with better quality information for object detection.

COCO Dataset

Common Objects in Context (COCO) is a large-scale dataset for detecting, segmenting, and captioning any object. 

FCN

Fully Convolutional Network (FCN) transforms the height and width of the intermediate layer (feature map) back to the original size so that predictions have a one-to-one correspondence with the input image. 

R-FCN

R-FCN corresponds to a region-based fully convolutional network. It is mainly used for feature detection. R-FCN comprises region-based feature maps that are independent of region proposals (ROI) and carry computation outside of ROIs. It is much simpler and about 20 times faster than R-CNN. 

TensorFlow

It is an open-source software library developed by Google Brain for a range of dataflow and differential programming applications. It is also useful in neural network programming. 

Also read – How are Medical Images shared among Healthcare Enterprises



Cancel

Knowledge thats worth delivered in your inbox

NPS in Insurance Claims: What Insurance Leaders Are Doing Differently

Claims are the moment of truth. Are you turning them into moments of loyalty?

In insurance, your app interface might win you downloads. Your pricing might drive conversions.
But it’s the claims experience that decides whether a customer stays—or leaves for good.

According to a survey by NPS Prism, promoters are 2.3 times more likely to renew their insurance policies than passives or detractors—highlighting the strong link between customer advocacy and retention.

NPS in insurance industry is a strong predictor of customer retention. Many insurers are now prioritizing NPS to improve their claims experience.

So, what are today’s high-NPS insurers doing differently? Spoiler: it’s not just about faster payouts.

We’ve worked with claims teams that had best-in-class automation—but still had low NPS. Why? Because the process felt like a black box.
Customers didn’t know where their claim stood. They weren’t sure what to do next. And when money was at stake, silence created anxiety and dissatisfaction.

Great customer experience (CX) in claims isn’t just about speed—it’s about giving customers a sense of control through clear communication and clarity.

The Traditional Claims Journey

  • Forms → Uploads → Phone calls → Waiting
  • No real-time updates
  • No guidance after claim initiation
  • Paper documents and email ping-pong

The result? Frustrated customers and overwhelmed call centers.

The CX Gap: It’s Not Just Speed—It’s Transparency

Customers don’t always expect instant decisions. What they want:

  • To know what’s happening with their claim
  • To understand what’s expected of them
  • To feel heard and supported during the process

How NPS Leaders Are Winning Loyalty with CX-Driven Claims and High NPS

Image Source: NPS Prism

1. Real-Time Status Updates

Transparency to the customer via mobile app, email, or WhatsApp—keeping them in the loop with clear milestones. 

2. Proactive Nudges

Auto-reminders, such as “upload your medical bill” or “submit police report,” help close matters much faster and avoid back-and-forth.

3. AI-Powered Document Uploads

Single-click scans with OCR + AI pull data instantly—no typing, no errors.

4. In-the-Moment Feedback Loops

Simple post-resolution surveys collect sentiment and alert on issues in real time.

For e.g., Lemonade uses emotional AI to detect customer sentiment during the claims process, enabling empathetic responses that boost satisfaction and trust.

Smart Nudges from Real-Time Journey Tracking

For a leading insurance firm, we mapped the entire in-app user journey—from buying or renewing a policy to initiating a claim or checking discounts. This helped identify exactly where users dropped off. Based on real-time activity, we triggered personalized notifications and offers—driving better engagement and claim completion rates.

Tech Enablement

  • Claims Orchestration Layer: Incorporates legacy systems, third-party tools, and front-end apps for a unified experience.
  • AI & ML Models: For document validation, fraud detection, and claim routing, sentiment analysis is used. Businesses utilizing emotional AI report a 25% increase in customer satisfaction and a 30% decrease in complaints, resulting in more personalized and empathetic interactions.
  • Self-Service Portals: Customers can check their status, update documents, and track payouts—all without making a phone call.

Business Impact

What do insurers gain from investing in CX?

A faster claim is good. But a fair, clear, and human one wins loyalty.

And companies that consistently track and act on CX metrics are better positioned to retain customers and build long-term loyalty.

At Mantra Labs, we help insurers build end-to-end, tech-enabled claims journeys that delight customers and drive operational efficiency.
From intelligent document processing to AI-led nudges, we design for empathy at scale.

Want a faster and more transparent claims experience?

Let’s design it together.
Talk to our insurance transformation team today.

Cancel

Knowledge thats worth delivered in your inbox

Loading More Posts ...
Go Top
ml floating chatbot