Learn about the technology options available for the social media sentiment analysis use case, compare them, and choose the right technology for the modules.
- [Instructor] We now look at technology options,…for the sentiment analysis use case.…We first start off, with an engine,…that can do real time data stream processing.…Here are the goals for this technology.…The technology should provide minimal latency,…in greeting messages from the incoming stream,…processing them, and delivering the output.…It should also have a high throughput.…This includes parallel processing capabilities.…It should be horizontally scalable,…to accommodate increase in loads,…without a need for re-architecture.…
A key feature for search engines,…is the ability to program them…in the language of your choice.…Finally, the engine should have good integrations,…with other systems, like message queues,…web services, and data bases.…We first start with Apache Storm.…Apache Storm, is a free and open source distributed…real-time computation system.…It is quite popular, for real-time analytics.…Storm processes the incoming stream,…message by message.…
It has minimum latency, and it is very suitable…
There is no coding involved. Instead you will see how big data tools can help solve some of the most complex challenges for businesses that generate, store, and analyze large amounts of data. The use cases are drawn from a variety of industries, including ecommerce and IT. Instructor Kumaran Ponnambalam shows how to analyze a problem, draw an architectural outline, choose the right technologies, and finalize the solution. After each use case, he reviews related best practices for real-time streaming, predictive analytics, parallel processing, and pipeline management. Each lesson is rich in practical techniques and insights from a developer who has experienced the benefits and shortcomings of these technologies firsthand.
- Components of a big data application
- Big data app development strategies
- Use cases: fraud detection and product recommendations
- Technology options
- Designing solutions
- Best practices