Scalable Machine Learning on Big Data using Apache Spark
Scalable Machine Learning on Big Data using Apache Spark – Certificate
IBM – Scalable Machine Learning on Big Data using Apache Spark
About this Course
This course will empower you with the skills to scale data science and machine learning (ML) tasks on Big Data sets using Apache Spark. Most real world machine learning work involves very large data sets that go beyond the CPU, memory and storage limitations of a single computer.
Apache Spark is an open source framework that leverages cluster computing and distributed storage to process extremely large data sets in an efficient and cost effective manner. Therefore an applied knowledge of working with Apache Spark is a great asset and potential differentiator for a Machine Learning engineer.
After completing this course, you will be able to:
- – gain a practical understanding of Apache Spark, and apply it to solve machine learning problems involving both small and big data
- – understand how parallel code is written, capable of running on thousands of CPUs.
- – make use of large scale compute clusters to apply machine learning algorithms on Petabytes of data using Apache SparkML Pipelines.
- – eliminate out-of-memory errors generated by traditional machine learning frameworks when data doesn’t fit in a computer’s main memory
- – test thousands of different ML models in parallel to find the best performing one – a technique used by many successful Kagglers
- – (Optional) run SQL statements on very large data sets using Apache SparkSQL and the Apache Spark DataFrame API.
Learn the machine learning techniques for working with Big Data that have been successfully applied by companies like Alibaba, Apple, Amazon, Baidu, eBay, IBM, NASA, Samsung, SAP, TripAdvisor, Yahoo!, Zalando and many others. NOTE: You will practice running machine learning tasks hands-on on an Apache Spark cluster provided by IBM at no charge during the course which you can continue to use afterwards.
- – basic python programming
- – basic machine learning (optional introduction videos are provided in this course as well)
- – basic SQL skills for optional content
IBM offers a wide range of technology and consulting services; a broad portfolio of middleware for collaboration, predictive analytics, software development and systems management; and the world’s most advanced servers and supercomputers. Utilizing its business consulting, technology and R&D expertise, IBM helps clients become “smarter” as the planet becomes more digitally interconnected. IBM invests more than $6 billion a year in R&D, just completing its 21st year of patent leadership. IBM Research has received recognition beyond any commercial technology research organization and is home to 5 Nobel Laureates, 9 US National Medals of Technology, 5 US National Medals of Science, 6 Turing Awards, and 10 Inductees in US Inventors Hall of Fame.