Dataconomy
  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
Subscribe
No Result
View All Result
Dataconomy
  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
Subscribe
No Result
View All Result
Dataconomy
No Result
View All Result

Netflix is Revamping their Data Architecture to Handle Streaming Movies to Millions

by Dataconomy News Desk
March 6, 2015
in Data Science, News
Home Topics Data Science
Share on FacebookShare on TwitterShare on LinkedInShare on WhatsAppShare on e-mail

Netflix’s growth over the last seven years has led to the provider of on-demand Internet streaming media, utilize ‘robust and scalable architecture’ in order to manage and process user viewing data.

Following an announcement earlier this week that they’re open sourcing their data-analysis-on-Hadoop tools, Netflix have now revealed the need for and imminent overhaul of the fundamentals of their computing architecture ‘in order to scale to the next order of magnitude’.

Netflix divides the use cases into three generic categories that affect user experience, aiming for the minimum viable set of use cases, rather than building an all-encompassing solution:

  1. What titles has the user watched
  2. Where a user stopped watching a given title
  3. What else is being watched on that user account right now

However, the stateful tier that emerged in order to tap the ‘benefits of memory speed for our highest volume read/write use cases,’ was more complex than existing mature open source technologies.

Acquiring the next order of magnitude, by ‘re-architecting a critical system to scale’ would at best take time, development, testing and ‘migrating off of the previous architecture,’ points out Netflix.

The redesign of the architecture would follow certain guidelines:

  • The design would favour availability rather than strong consistency in the face of failures.
  • Microservices – Components that were combined together in the stateful architecture should be separated out into services (components as services).
    • Components are defined according to their primary purpose – either collection, processing, or data providing.
    • Delegate responsibility for state management to the persistence tiers, keeping the application tiers stateless.
    • Decouple communication between components by using signals sent through an event queue.
  • Polyglot persistence – Use multiple persistence technologies to leverage the strengths of each solution.
    • Achieve flexibility + performance at the cost of increased complexity.
    • Use Cassandra for very high volume, low latency writes.  A tailored data model and tuned configuration enables low latency for medium volume reads.
    • Use Redis for very high volume, low latency reads.

Read the full blog post here.

(Image credit: Matteo Bittnati, via Flickr)

Tags: CassandraData ArchitectureNetflixRedis

Related Posts

Unraveling the Johnson Controls Ransomware attack: Dark Angels wants  million

Unraveling the Johnson Controls Ransomware attack: Dark Angels wants $51 million

September 29, 2023
Explained: How to use Meta AI

Explained: How to use Meta AI

September 29, 2023
Talkie: Soulful AI offers a smooth AI chatbot expeirence

Talkie: Soulful AI offers a smooth AI chatbot expeirence

September 29, 2023
AI and machine learning’s  impact on startups

AI and machine learning’s impact on startups

September 29, 2023
Capital One data breach settlement payments have started

Capital One data breach settlement payments have started

September 29, 2023
Meta AI Assistant is coming to help you on WhatsApp, Messenger, and Instagram

Meta AI Assistant is coming to help you on WhatsApp, Messenger, and Instagram

September 29, 2023

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

LATEST ARTICLES

Unraveling the Johnson Controls Ransomware attack: Dark Angels wants $51 million

Our natural response to malfunctioning tech is often spot-on

Celebrating Europe’s tech startup elite: The Europas Awards return!

Explained: How to use Meta AI

Talkie: Soulful AI offers a smooth AI chatbot expeirence

AI and machine learning’s impact on startups

Dataconomy

COPYRIGHT © DATACONOMY MEDIA GMBH, ALL RIGHTS RESERVED.

  • About
  • Imprint
  • Contact
  • Legal & Privacy
  • Partnership
  • Writers wanted

Follow Us

  • News
  • AI
  • Big Data
  • Machine Learning
  • Trends
    • Blockchain
    • Cybersecurity
    • FinTech
    • Gaming
    • Internet of Things
    • Startups
    • Whitepapers
  • Industry
    • Energy & Environment
    • Finance
    • Healthcare
    • Industrial Goods & Services
    • Marketing & Sales
    • Retail & Consumer
    • Technology & IT
    • Transportation & Logistics
  • Events
  • About
    • About Us
    • Contact
    • Imprint
    • Legal & Privacy
    • Newsletter
    • Partner With Us
    • Writers wanted
No Result
View All Result
Subscribe

This website uses cookies. By continuing to use this website you are giving consent to cookies being used. Visit our Privacy Policy.