New used memory from field would be larger than configured

[ssoliveira]

Hi Cdienger,

The use is around 12 GiB at the moment.

The performance is good.

The data mass is around 2 billion documents (57 indices - open).

I believe we can close this ticket.

datalog-ugt-log1 > 12511637424 > 11.65 GiB
datalog-ugt-log2 > 12925829688 > 12.04 GiB
datalog-utb-log1 > 12326589096 > 11.48 GiB
datalog-utb-log2 > 12941594256 > 12.05 GiB

If necessary I will return to the forum.
Thank you.

Code: Select all

[root@datalog-ugt-log1 ~]# curl -XGET 'http://localhost:9200/_nodes/stats/indices/fielddata?pretty'
{
  "cluster_name" : "a5726a09-769e-4f2b-be91-d786c8165c6f",
  "nodes" : {
    "7ieEKFyvTX-E-KVki_NhBA" : {
      "timestamp" : 1499190510873,
      "name" : "765cc658-3e5f-4923-804e-5eb57735f761",
      "transport_address" : "inet[/10.0.0.21:9300]",
      "host" : "datalog-utb-log1",
      "ip" : [ "inet[/10.0.0.21:9300]", "NONE" ],
      "attributes" : {
        "max_local_storage_nodes" : "1"
      },
      "indices" : {
        "fielddata" : {
          "memory_size_in_bytes" : 12326589096,
          "evictions" : 0
        }
      }
    },
    "oNgAB8szRLGP7mLoQB8Wmw" : {
      "timestamp" : 1499190510873,
      "name" : "8471b9e1-1a82-4c3d-98bc-03f2ce871369",
      "transport_address" : "inet[/10.0.0.11:9300]",
      "host" : "datalog-ugt-log1",
      "ip" : [ "inet[/10.0.0.11:9300]", "NONE" ],
      "attributes" : {
        "max_local_storage_nodes" : "1"
      },
      "indices" : {
        "fielddata" : {
          "memory_size_in_bytes" : 12511637424,
          "evictions" : 0
        }
      }
    },
    "d-kSl7BuRVyUkWBAtOwF1Q" : {
      "timestamp" : 1499190510873,
      "name" : "5c998cfb-0460-4e56-8697-83b65c086a13",
      "transport_address" : "inet[/10.0.0.12:9300]",
      "host" : "datalog-ugt-log2",
      "ip" : [ "inet[/10.0.0.12:9300]", "NONE" ],
      "attributes" : {
        "max_local_storage_nodes" : "1"
      },
      "indices" : {
        "fielddata" : {
          "memory_size_in_bytes" : 12925829688,
          "evictions" : 3
        }
      }
    },
    "D6-Vd48OQjePpR8qDDlauw" : {
      "timestamp" : 1499190510873,
      "name" : "8d4f2dfb-f10c-4655-a4b7-8b5eaa9f6a3c",
      "transport_address" : "inet[/10.0.0.22:9300]",
      "host" : "datalog-utb-log2",
      "ip" : [ "inet[/10.0.0.22:9300]", "NONE" ],
      "attributes" : {
        "max_local_storage_nodes" : "1"
      },
      "indices" : {
        "fielddata" : {
          "memory_size_in_bytes" : 12941594256,
          "evictions" : 0
        }
      }
    }
  }
}