4개 굉장한 오픈 소스 소프트웨어 | 웹 스크래핑 툴 | ScrapeStorm

Many companies use open source tools to run their IT infrastructure and websites, some provide products and services related to open source tools, or products and services built on open source tools, and some are contributing code to or supporting open source projects .

This time, we will introduce some of the open source projects most favored by technology companies.

1. Hadoop

Apache Hadoop is a collection of open-source software utilities that facilitates using a network of many computers to solve problems involving massive amounts of data and computation. It provides a software framework for distributed storage and processing of big data using the MapReduce programming model.

Supported systems: Windows, Linux and OS X
Website: http://hadoop.apache.org

2. Hypertable

Hypertable was an open-source software project to implement a database management system inspired by publications on the design of Google’s Bigtable. Hypertable runs on top of a distributed file system such as the Apache HDFS, GlusterFS or the CloudStore Kosmos File System.

Supported systems: Linux and OS X
Website: http://www.hypertable.com

3. Mesos

Apache Mesos is a resource abstraction tool. With it, companies can use the entire data center as a resource pool. It is popular among companies that run Hadoop, Spark, and similar applications.

4. Spark

Apache Spark is an open-source unified analytics engine for large-scale data processing. Spark provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.