Search code examples
hadoophadoop-streaminghadoop2rhadoop

where does region server present and other?


  1. Where does region servers present? Is it with data nodes or else the region servers, regions are present in different hardwares.

  2. Does WAL consists of data of a table along with operation?

  3. What does memstore does? It stored data of WAL means along with data?

  4. What does zookeeper actually do?


Solution

  • 1.The Region servers are present in the same place whee the data node lies. They are responsble to store the data as 3 replicas in hdfs.

    2.WAL is something like transaction log inSQL server it sores all operations and executes its operations when some thing failed while storing(inorder to lost data it will provide as backup).

    3.While writing the data initially stores into WAL then to memstore when the limit of memstore(threshold level) is reached then data is flushed to hflie wich is present in same store.

    4.It stores the -.ROOT.- table which consists of info of cluster and it helps to client while reading data. ie:It providing path to find data to client.