I'm running Elasticsearch (floragunncom/sg-elasticsearch:7.1.1-oss-35.0.0) on the Kubernetes cluster.
To change the default password of internal user admin
, I have updated the hash
for the admin
user in plugins/search-guard-7/sgconfig/sg_internal_users.yml
file. And let the Elasticsearch bootstrapped with the updated file.
$ kubectl exec -it -n demo master-topology-es-1 bash
kubectl exec [POD] [COMMAND] is DEPRECATED and will be removed in a future version. Use kubectl kubectl exec [POD] -- [COMMAND] instead.
[root@master-topology-es-1 elasticsearch]# cat plugins/search-guard-7/sgconfig/sg_internal_users.yml
_sg_meta:
type: "internalusers"
config_version: 2
admin:
hash: $2a$12$BqN5ov9wf2Xw5T5UKFJARuV.Top7/oKYQHfpBhIRVvKKSyy7XWxYm <--- here
...
...
With a couple of WARN
messages, the cluster initialized. And works perfectly with the updated password.
{"type": "server", "timestamp": "2020-08-19T19:44:53,727+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=null)" }
{"type": "server", "timestamp": "2020-08-19T19:44:53,728+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=null)" }
{"type": "server", "timestamp": "2020-08-19T19:44:53,731+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "No data for config while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=null)" }
{"type": "server", "timestamp": "2020-08-19T19:44:53,731+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "No data for roles while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=null)" }
{"type": "server", "timestamp": "2020-08-19T19:44:53,733+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "No data for rolesmapping while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=null)" }
{"type": "server", "timestamp": "2020-08-19T19:44:53,736+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=null)" }
{"type": "server", "timestamp": "2020-08-19T19:45:02,349+0000", "level": "INFO", "component": "c.f.s.c.ConfigurationRepository", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "Search Guard License Info: No license needed because enterprise modules are not enabled" }
{"type": "server", "timestamp": "2020-08-19T19:45:02,349+0000", "level": "INFO", "component": "c.f.s.c.ConfigurationRepository", "cluster.name": "topology-es", "node.name": "data-topology-es-1", "cluster.uuid": "P7zRvRjUSnuMGMn9bYzqBg", "node.id": "4SigRNAnSc-A8EuAOnhvAQ", "message": "Node 'data-topology-es-1' initialized" }
But when I try the same but a custom user in plugins/search-guard-7/sgconfig/sg_internal_users.yml
along with other internal users.
_sg_meta:
type: "internalusers"
config_version: 2
admin:
...
kibanaro:
...
logstash:
...
readall:
...
snapshotrestore:
...
readall_monitor: <---- here
hash: $2a$12$jZ4VqN397eilnlofOJOIbOR/yvU4ooEzMlVHWJjhsPUwf8K1AcmTO
search_guard_roles:
- SGS_READALL_AND_MONITOR
This time, the WARM
messages never end. It keeps repeating the same logs.
{"type": "server", "timestamp": "2020-08-19T19:10:18,303+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:18,304+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:18,309+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:26,301+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:26,302+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:26,318+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:34,303+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:34,304+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:34,312+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:42,305+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:42,306+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:42,312+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:50,308+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:50,309+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:50,316+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:58,309+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:58,309+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:10:58,314+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:06,311+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:06,312+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:06,316+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:14,311+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:14,312+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:14,321+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:22,313+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for internalusers while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:22,313+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for actiongroups while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
{"type": "server", "timestamp": "2020-08-19T19:11:22,317+0000", "level": "WARN", "component": "c.f.s.c.ConfigurationLoaderSG7", "cluster.name": "topology-es", "node.name": "master-topology-es-0", "cluster.uuid": "GjLznJURQX2g8AsZ2PC45Q", "node.id": "z9XlpvozT9mf_hoJRR3jkA", "message": "No data for tenants while retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS] (index=searchguard and type=_doc)" }
So, the cluster remains uninitialized.
$ curl -XGET "https://localhost:9200/_cluster/health?pretty" -u "admin:x3xqurkg" --insecure
Search Guard not initialized (SG11). See https://docs.search-guard.com/latest/sgadmin
- How to handle those
WARN
logs? - Any idea what am I missing or how to debug such problems?
- Why the index type varies in the logs from
index=searchguard and type=null
toindex=searchguard and type=_doc
?