一月初新内容速递丨数据管控、图表应用与函数启航

新年伊始,学习继续!一月上旬更新聚焦数据安全、图表实战、函数入门与场景深化,助你在数据智能的旅程中稳健开年!

一、技术经验分享

精细化管控数据导出,让敏感数据无处泄露!→加强数据安全管理,有效防止敏感信息外泄,提升企业数据合规性。

二、任务持续上线

【图表应用】散点图精准洞察分布→学习散点图制作与分析,掌握数据分布洞察技巧。
【函数】新手村试炼:计算度量入门挑战→函数入门实战,轻松攻克计算度量基础。
【图表应用】热力地图:看透市场浓度的战略眼→掌握热力地图绘制,直观识别市场热度分布。
BI知识闯关】精细化管控数据导出,让敏感数据无处泄露!》→巩固数据安全知识,提升管控实战能力。
【新年活动】年货采购数据侦探→结合新年主题,锻炼数据筛选与分析能力。

三、场景应用精选

价值引擎:汽车制造财务分析主题课程→延续财务数据分析实战,助力企业决策与价值挖掘。
【地图】散点地图:精确落位,洞察分布→学习散点地图应用,实现地理位置数据的可视化呈现。
【地图】热力地图:一眼识别业务“高地”与“洼地”》→掌握热力地图在业务分析中的实战应用。

四、二次开发视频更新

Excel导入模板扩展校验类》→深入学习Excel导入功能的扩展校验技术,提升数据导入的准确性与规范性。

五、活动进行中

新年第①弹|年货采购数据挑战:你能答对几题?》→趣味数据挑战赛,检验你的数据分析能力,赢取开年好礼。

六、官方通知发布

2025年度任务排行榜大揭晓!》→回顾2025年度学习成果,揭晓任务完成排行榜,激励持续学习。

七、函数应用入门

【函数课堂】函数总览篇:告别“不会用计算度量”的焦虑》→系统讲解函数使用,帮助你轻松入门计算度量,摆脱使用困惑。

麦粉社区
>
帖子详情

数据模型抽取失败

其它 发表于 2025-6-6 09:39
发表于 2025-6-6 09:39:05
本帖最后由 smt46SA5M21287STZ2 于 2025-6-10 08:30 编辑

数据模型抽取失败。


数据模型每隔一个月就会发生抽取报错的现象,该如何解决呢?


create time: 2025-06-06 08:51:18
extract param:{"paramValues":{"$$extractInfo$$":{"value":{"extractType":"FULL","incrementalType":null,"incrementalRows":null,"incrementalRowIndexs":null,"fieldIdMapping":null,"formatMapping":null,"clearBeforeExtract":true,"extractCurrentDay":false,"reExtractInterval":0,"reExtractTimeUnit":null,"dbType":null,"srcCsvPaths":null,"lastExtractType":"FULL","lastIncrementalType":null,"lastIncrementalRows":[],"lastSelectAllSql":null,"failModel":"CONTINUE","rejectMaxRecord":2147483647,"rejectRecordFile":"","rejectReasonFile":"","realExtractType":"FULL","logSelectAllSql":null,"lastExtractState":true,"keepRejectRecord":true,"keepRejectReason":true},"displayValue":null,"noValue":false}},"offset":0,"limit":9223372036854775807,"sample":false,"userName":null,"cacheIdentity":"null09223372036854775807false$$extractInfo$$smartbix.augmenteddataset.extract.save2csv.ExtractInfo@2e6f5bd1null","extract":false}/nsmartbix.augmenteddataset.extract.SmartbiXException: 抽取未完成或抽取失败: delete SmartbiCache tableFail:drop table if exists `smartbimpp`.`xniiwwq5jahwiajqitfla` ON CLUSTER `smartbi_cluster_1S_2R` SYNC
smartbix.SmartbiXException: SQL错误: drop table if exists `smartbimpp`.`xniiwwq5jahwiajqitfla` ON CLUSTER `smartbi_cluster_1S_2R` SYNC  -> ClickHouse exception, code: 1002, host: 10.36.21.153, port: 8088; Code: 999. Coordination::Exception: Connection loss, path: /clickhouse/task_queue/ddl/query-0000623273: While executing DDLQueryStatus. (KEEPER_EXCEPTION) (version 22.8.5.29 (official build))

        at smartbix.SmartbiXException.create(SmartbiXException.java:68)
        at smartbix.smartbi.service.GridDataServiceHandler.handle(GridDataServiceHandler.java:118)
        at sun.reflect.GeneratedMethodAccessor607.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at smartbixlibs.org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
        at smartbixlibs.org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
        at smartbixlibs.org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
        at smartbixlibs.org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
        at smartbixlibs.org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
        at smartbixlibs.org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
        at smartbix.dataprocess.service.DatabaseResultService$$EnhancerBySpringCGLIB$$498909bf.executeDmlSql()
        at smartbix.augmenteddataset.repository.service.AugmentedDatabaseResultService.executeDmlSql(AugmentedDatabaseResultService.java:53)
        at smartbix.augmenteddataset.extract.save2csv.SmartbiCacheExtractor.createTargetTable(SmartbiCacheExtractor.java:1538)
        at smartbix.augmenteddataset.extract.save2csv.SmartbiCacheExtractor.extractDbTable(SmartbiCacheExtractor.java:672)
        at smartbix.augmenteddataset.extract.save2csv.SmartbiCacheExtractor.export(SmartbiCacheExtractor.java:300)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor.extractextractInternal(SingleThreadedExtractor.java:469)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor.access$1500(SingleThreadedExtractor.java:94)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor$2.call(SingleThreadedExtractor.java:382)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor$2.call(SingleThreadedExtractor.java:366)
        at smartbix.augmenteddataset.extract.ExtractTaskWrapper.call(ExtractTaskWrapper.java:40)
        at smartbix.util.ThreadUtil$SubmitRunnable.call(ThreadUtil.java:220)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: ru.yandex.clickhouse.except.ClickHouseUnknownException: ClickHouse exception, code: 1002, host: 10.36.21.153, port: 8088; Code: 999. Coordination::Exception: Connection loss, path: /clickhouse/task_queue/ddl/query-0000623273: While executing DDLQueryStatus. (KEEPER_EXCEPTION) (version 22.8.5.29 (official build))

        at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.getException(ClickHouseExceptionSpecifier.java:92)
        at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.specify(ClickHouseExceptionSpecifier.java:56)
        at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.specify(ClickHouseExceptionSpecifier.java:29)
        at ru.yandex.clickhouse.ClickHouseStatementImpl.checkForErrorAndThrow(ClickHouseStatementImpl.java:1099)
        at ru.yandex.clickhouse.ClickHouseStatementImpl.getInputStream(ClickHouseStatementImpl.java:778)
        at ru.yandex.clickhouse.ClickHouseStatementImpl.getLastInputStream(ClickHouseStatementImpl.java:692)
        at ru.yandex.clickhouse.ClickHouseStatementImpl.executeUpdate(ClickHouseStatementImpl.java:434)
        at org.apache.commons.dbcp.DelegatingStatement.executeUpdate(DelegatingStatement.java:228)
        at org.apache.commons.dbcp.DelegatingStatement.executeUpdate(DelegatingStatement.java:228)
        at org.apache.commons.dbcp.DelegatingStatement.executeUpdate(DelegatingStatement.java:228)
        at smartbix.dataprocess.service.DatabaseResultService.executeDmlSql(DatabaseResultService.java:468)
        at smartbix.dataprocess.service.DatabaseResultService$$FastClassBySpringCGLIB$$7e915f15.invoke()
        at smartbixlibs.org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
        at smartbixlibs.org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at smartbixlibs.org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
        at smartbixlibs.org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:102)
        at smartbix.smartbi.service.GridDataServiceHandler.handle(GridDataServiceHandler.java:93)
        ... 27 more
Caused by: java.lang.Throwable: Code: 999. Coordination::Exception: Connection loss, path: /clickhouse/task_queue/ddl/query-0000623273: While executing DDLQueryStatus. (KEEPER_EXCEPTION) (version 22.8.5.29 (official build))

        at ru.yandex.clickhouse.except.ClickHouseExceptionSpecifier.specify(ClickHouseExceptionSpecifier.java:54)
        ... 43 more

        at smartbix.augmenteddataset.extract.SmartbiXException.create(SmartbiXException.java:24)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor.extractextractInternal(SingleThreadedExtractor.java:477)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor.access$1500(SingleThreadedExtractor.java:94)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor$2.call(SingleThreadedExtractor.java:382)
        at smartbix.augmenteddataset.extract.SingleThreadedExtractor$2.call(SingleThreadedExtractor.java:366)
        at smartbix.augmenteddataset.extract.ExtractTaskWrapper.call(ExtractTaskWrapper.java:40)
        at smartbix.util.ThreadUtil$SubmitRunnable.call(ThreadUtil.java:220)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
发表于 2025-6-6 14:22:30
这个看着有连接断开?有没有更完整的日志

回复

使用道具 举报

高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

4回帖数 0关注人数 696浏览人数
最后回复于:2025-6-6 14:22
快速回复 返回顶部 返回列表