Modeshape index errors when upgrading from 0.8.3 to 0.8.4

Description

1. start with 0.8.3
2. upgrade to 0.8.4

The system will throw errors trying to index kylo-feeds and kylo-categories. Stack trace below

This will happen both when the upgrader app is launchced, or after you have upgraded and just running the application.

When do the 'kylo-feeds' and 'kylo-categories' indexes get created.

.modeshape.security.AdminAuthenticationProvider or any of its super types
2017-11-22 17:54:19 ERROR localhost-startStop-1:EsIndexProvider:166 - Error updating index 'kylo-categories' in workspace 'metadata' with definition: kylo-categories@elasticsearch nodeType=tba:category columns=jcr:title(STRING),jcr:description(STRING),tba:systemName(STRING) kind=TEXT sync=false workspaces=*
org.modeshape.jcr.index.elasticsearch.EsIndexException: java.io.IOException: Not Found
at org.modeshape.jcr.index.elasticsearch.EsIndex.createIndex(EsIndex.java:95)
at org.modeshape.jcr.index.elasticsearch.EsIndex.<init>(EsIndex.java:57)
at org.modeshape.jcr.index.elasticsearch.EsManagedIndexBuilder.buildTextIndex(EsManagedIndexBuilder.java:102)
at org.modeshape.jcr.spi.index.provider.ManagedIndexBuilder.build(ManagedIndexBuilder.java:146)
at org.modeshape.jcr.spi.index.provider.IndexProvider.createIndex(IndexProvider.java:1278)
at org.modeshape.jcr.spi.index.provider.IndexProvider.notify(IndexProvider.java:977)
at org.modeshape.jcr.RepositoryIndexManager.initialize(RepositoryIndexManager.java:187)
at org.modeshape.jcr.RepositoryQueryManager.initialize(RepositoryQueryManager.java:105)
at org.modeshape.jcr.JcrRepository$RunningState.completeInitialization(JcrRepository.java:1279)
at org.modeshape.jcr.JcrRepository.doStart(JcrRepository.java:377)
at org.modeshape.jcr.JcrRepository.getStartupProblems(JcrRepository.java:289)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig.metadataJcrRepository(ModeShapeEngineConfig.java:143)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig$$EnhancerBySpringCGLIB$$6f39b311.CGLIB$metadataJcrRepository$3(<generated>)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig$$EnhancerBySpringCGLIB$$6f39b311$$FastClassBySpringCGLIB$$45cb17ea.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig$$EnhancerBySpringCGLIB$$6f39b311.metadataJcrRepository(<generated>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162)
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:545)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88)
at .....

2017-11-22 17:54:19 ERROR localhost-startStop-1:EsIndexProvider:166 - Error updating index 'kylo-categories' in workspace 'default' with definition: kylo-categories@elasticsearch nodeType=tba:category columns=jcr:title(STRING),jcr:description(STRING),tba:systemName(STRING) kind=TEXT sync=false workspaces=*
org.modeshape.jcr.index.elasticsearch.EsIndexException: java.io.IOException: Not Found
at org.modeshape.jcr.index.elasticsearch.EsIndex.createIndex(EsIndex.java:95)
at org.modeshape.jcr.index.elasticsearch.EsIndex.<init>(EsIndex.java:57)
at org.modeshape.jcr.index.elasticsearch.EsManagedIndexBuilder.buildTextIndex(EsManagedIndexBuilder.java:102)
at org.modeshape.jcr.spi.index.provider.ManagedIndexBuilder.build(ManagedIndexBuilder.java:146)
at org.modeshape.jcr.spi.index.provider.IndexProvider.createIndex(IndexProvider.java:1278)
at org.modeshape.jcr.spi.index.provider.IndexProvider.notify(IndexProvider.java:977)
at org.modeshape.jcr.RepositoryIndexManager.initialize(RepositoryIndexManager.java:187)
at org.modeshape.jcr.RepositoryQueryManager.initialize(RepositoryQueryManager.java:105)
at org.modeshape.jcr.JcrRepository$RunningState.completeInitialization(JcrRepository.java:1279)
at org.modeshape.jcr.JcrRepository.doStart(JcrRepository.java:377)
at org.modeshape.jcr.JcrRepository.getStartupProblems(JcrRepository.java:289)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig.metadataJcrRepository(ModeShapeEngineConfig.java:143)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig$$EnhancerBySpringCGLIB$$6f39b311.CGLIB$metadataJcrRepository$3(<generated>)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig$$EnhancerBySpringCGLIB$$6f39b311$$FastClassBySpringCGLIB$$45cb17ea.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:355)
at com.thinkbiganalytics.metadata.modeshape.ModeShapeEngineConfig$$EnhancerBySpringCGLIB$$6f39b311.metadataJcrRepository(<generated>)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162)
at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1123)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1018)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:510)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:545)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:331)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1214)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:543)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:545)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:331)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1214)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:543)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:482)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1192)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1116)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1014)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:545)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88)
at

Environment

None

Activity

Show:
Jagrut Sharma
November 27, 2017, 5:50 PM

A script is provided to pre-create indexes to prevent this error. It is available at:
/opt/kylo/bin/create-kylo-indexes-es.sh

Documentation around this is here:
Kylo & Global Search

Scott Reisdorf
November 27, 2017, 6:09 PM

Update the release notes to run the script

Jagrut Sharma
November 27, 2017, 9:36 PM

Updated 0.8.4 release notes with step in case it was skipped during installation of an earlier version.

Done

Assignee

Jagrut Sharma

Reporter

Scott Reisdorf

Labels

None

Reviewer

None

Story point estimate

None

Sprint

None

Fix versions

Priority

High