Hadoop Administration
A place to discuss all Hadoop admin issues - Go green
Monday, November 4, 2019
Hive Architecture in Depth
Click here for Complete Architecture of Hive
No comments:
Post a Comment
Newer Post
Older Post
Home
Subscribe to:
Post Comments (Atom)
Hive Architecture
Hive Architecture in One Image
Step by step process of Changing Ambari Metrics Collector service from Embedded to distributed mode - HDP
Steps: # STOP AMS service # Create directories in HDFS $ hdfs dfs -mkdir -p /apps/ams/metrics $ hdfs dfs -chown -R ams:hadoop /apps/...
Some Spark Issues
1. Too many open files This issue(Too many open files) is fixed by setting ulimit to 10000 or there can be corrupted disks on...
Delete Old log files from HDFS - Older than 10 days
Script: ( Tested ) : today=`date +'%s'` hdfs dfs -ls /file/Path/ | grep "^d" | while read line ; do dir_date=$(echo ${...
No comments:
Post a Comment