We are facing heap issues in elastic search 1.7.3 version for all the data nodes. Please find the below steps what we have implemented in my cluster.
Step-1: We have total 16 data nodes and each node is having 3 instances (data1, data2 and data3) total we have 48 instances and 3 masters+ 16 separate ingest(search) nodes. All the data nodes are bare metals and each node is having 7.1TB disk. Filesystem Size Used Avail Use% Mounted on /dev/sdi2 132G 16G 110G 13% / devtmpfs 252G 0 252G 0% /dev tmpfs 252G 0 252G 0% /dev/shm tmpfs 252G 26M 252G 1% /run tmpfs 252G 0 252G 0% /sys/fs/cgroup /dev/mapper/Source--ES--eph-volume--367978823--14 7.0T 642G 6.4T 9% /app