麦粉社区
>
帖子详情

ODS 贴近业务源库

其它 发表于 半小时前
发表于 半小时前

  1. 业务库→ODS 用增量:ODS 贴近业务源库,增量抽取可以减少对业务库压力、减少传输数据量;ODS 保留原始变更流水,只同步新增 / 变更数据,一般依靠更新时间戳做增量标记Smartbi。

  2. ODS→DWD 全量:DWD 层要做清洗、去重、脏数据过滤、维度退化、规则标准化;清洗逻辑、业务规则随时可能调整。如果用增量,一旦清洗规则改了,历史明细无法自动重算;全量重跑可以保证当日 DWD 明细是统一口径、一致标准的数据。另外业务存在删数据、回溯修改历史单据场景,增量很难识别删除和历史回溯变更,容易造成 DWD 数据和源数据不一致。

  3. DWD→DWS 全量:DWS 是汇总层,是基于 DWD 明细做聚合统计(按日期、客户、商品汇总销售额等)。汇总计算依赖全部明细,只要明细里有历史单据修改、删除,汇总结果就需要全部重新计算;增量聚合逻辑复杂、容易出现累计误差,全量重新聚合保证汇总结果准确、对账方便,适合考试案例里的设计思路CSDN博...。

发表于 半小时前

weibo.com/ttarticle/p/show?comment=aa&id=2309405363461063836053
weibo.com/ttarticle/p/show?comment=aa&id=2309405360061878239238
weibo.com/ttarticle/p/show?comment=aa&id=2309405360061957931019
weibo.com/ttarticle/p/show?comment=aa&id=2309405360062037360897
weibo.com/ttarticle/p/show?comment=aa&id=2309405360062117314831
weibo.com/ttarticle/p/show?comment=aa&id=2309405360062540677168
weibo.com/ttarticle/p/show?comment=aa&id=2309405360062884872358
weibo.com/ttarticle/p/show?comment=aa&id=2309405360063304302704
weibo.com/ttarticle/p/show?comment=aa&id=2309405360065887993973
weibo.com/ttarticle/p/show?comment=aa&id=2309405360081658577071
weibo.com/ttarticle/p/show?comment=aa&id=2309405360066630385874
weibo.com/ttarticle/p/show?comment=aa&id=2309405360081956372592
weibo.com/ttarticle/p/show?comment=aa&id=2309405360082048385046
weibo.com/ttarticle/p/show?comment=aa&id=2309405360082887245899
weibo.com/ttarticle/p/show?comment=aa&id=2309405360082933645319
weibo.com/ttarticle/p/show?comment=aa&id=2309405360172171395230
weibo.com/ttarticle/p/show?comment=aa&id=2309405360173677150301
weibo.com/ttarticle/p/show?comment=aa&id=2309405360174327529496
weibo.com/ttarticle/p/show?comment=aa&id=2309405360174503690265
weibo.com/ttarticle/p/show?comment=aa&id=2309405360175153807522
weibo.com/ttarticle/p/show?comment=aa&id=2309405360175325511722
weibo.com/ttarticle/p/show?comment=aa&id=2309405360176139468934
weibo.com/ttarticle/p/show?comment=aa&id=2309405360176814489774
weibo.com/ttarticle/p/show?comment=aa&id=2309405360178593136763
weibo.com/ttarticle/p/show?comment=aa&id=2309405360178752258297
weibo.com/ttarticle/p/show?comment=aa&id=2309405360179092258876
weibo.com/ttarticle/p/show?comment=aa&id=2309405360179415220553
weibo.com/ttarticle/p/show?comment=aa&id=2309405360181889859790
weibo.com/ttarticle/p/show?comment=aa&id=2309405360182908813405
weibo.com/ttarticle/p/show?comment=aa&id=2309405360564703723643
weibo.com/ttarticle/p/show?comment=aa&id=2309405360564745666732
weibo.com/ttarticle/p/show?comment=aa&id=2309405360565274411194
weibo.com/ttarticle/p/show?comment=aa&id=2309405360568008835388
weibo.com/ttarticle/p/show?comment=aa&id=2309405360568524996716
weibo.com/ttarticle/p/show?comment=aa&id=2309405360569409994986
weibo.com/ttarticle/p/show?comment=aa&id=2309405360571137786287
weibo.com/ttarticle/p/show?comment=aa&id=2309405360571175534942
weibo.com/ttarticle/p/show?comment=aa&id=2309405360572664775038
weibo.com/ttarticle/p/show?comment=aa&id=2309405360572630958239
weibo.com/ttarticle/p/show?comment=aa&id=2309405360575948914743
weibo.com/ttarticle/p/show?comment=aa&id=2309405360577034977325
weibo.com/ttarticle/p/show?comment=aa&id=2309405360578389999818
weibo.com/ttarticle/p/show?comment=aa&id=2309405360581329944634
weibo.com/ttarticle/p/show?comment=aa&id=2309405360582915653780
weibo.com/ttarticle/p/show?comment=aa&id=2309405360584089796616
weibo.com/ttarticle/p/show?comment=aa&id=2309405360584127807513
weibo.com/ttarticle/p/show?comment=aa&id=2309405360589261635727
weibo.com/ttarticle/p/show?comment=aa&id=2309405360590569996739
weibo.com/ttarticle/p/show?comment=aa&id=2309405360371845431488
weibo.com/ttarticle/p/show?comment=aa&id=2309405360372009271336
weibo.com/ttarticle/p/show?comment=aa&id=2309405360372583628863
weibo.com/ttarticle/p/show?comment=aa&id=2309405360373074362430
weibo.com/ttarticle/p/show?comment=aa&id=2309405360375289217287
weibo.com/ttarticle/p/show?comment=aa&id=2309405360374962061464
weibo.com/ttarticle/p/show?comment=aa&id=2309405360379734917158
weibo.com/ttarticle/p/show?comment=aa&id=2309405360380066267266
weibo.com/ttarticle/p/show?comment=aa&id=2309405360380733161616
weibo.com/ttarticle/p/show?comment=aa&id=2309405360380897001681
weibo.com/ttarticle/p/show?comment=aa&id=2309405360381064773649
weibo.com/ttarticle/p/show?comment=aa&id=2309405360381400318142
weibo.com/ttarticle/p/show?comment=aa&id=2309405360381563633666
weibo.com/ttarticle/p/show?comment=aa&id=2309405360387943432363
weibo.com/ttarticle/p/show?comment=aa&id=2309405360388102816023
weibo.com/ttarticle/p/show?comment=aa&id=2309405360388266393650
weibo.com/ttarticle/p/show?comment=aa&id=2309405360388605870370
weibo.com/ttarticle/p/show?comment=aa&id=2309405360389805703170
weibo.com/ttarticle/p/show?comment=aa&id=2309405360390329991197
weibo.com/ttarticle/p/show?comment=aa&id=2309405360390501957641
weibo.com/ttarticle/p/show?comment=aa&id=2309405360391156006986
weibo.com/ttarticle/p/show?comment=aa&id=2309405360551248396644
weibo.com/ttarticle/p/show?comment=aa&id=2309405360551324155912
weibo.com/ttarticle/p/show?comment=aa&id=2309405360551538065677
weibo.com/ttarticle/p/show?comment=aa&id=2309405360552053965156
weibo.com/ttarticle/p/show?comment=aa&id=2309405360552708014245
weibo.com/ttarticle/p/show?comment=aa&id=2309405360552750219375
weibo.com/ttarticle/p/show?comment=aa&id=2309405360552955740174
weibo.com/ttarticle/p/show?comment=aa&id=2309405360553022587146
weibo.com/ttarticle/p/show?comment=aa&id=2309405360553639411944
weibo.com/ttarticle/p/show?comment=aa&id=2309405360553802727440
weibo.com/ttarticle/p/show?comment=aa&id=2309405360453789548564
weibo.com/ttarticle/p/show?comment=aa&id=2309405360453957582858
weibo.com/ttarticle/p/show?comment=aa&id=2309405360456465514533
weibo.com/ttarticle/p/show?comment=aa&id=2309405360456784281760
weibo.com/ttarticle/p/show?comment=aa&id=2309405360456948121631
weibo.com/ttarticle/p/show?comment=aa&id=2309405360457107243143
weibo.com/ttarticle/p/show?comment=aa&id=2309405360457346318437
weibo.com/ttarticle/p/show?comment=aa&id=2309405360458512597097
weibo.com/ttarticle/p/show?id=2309405360796392882309&/qt6a
weibo.com/ttarticle/p/show?id=2309405360796502196280&/huy
weibo.com/ttarticle/p/show?id=2309405361288745452101&/jp1
weibo.com/ttarticle/p/show?id=2309405361292126322766&/15h
weibo.com/ttarticle/p/show?id=2309405361295720579382&/m7l8
weibo.com/ttarticle/p/show?id=2309405361296907567234&/znw
weibo.com/ttarticle/p/show?id=2309405361299785121906&/kmbe
weibo.com/ttarticle/p/show?id=2309405361302314287232&/qh3
weibo.com/ttarticle/p/show?id=2309405361304671224049&/dxzl
weibo.com/ttarticle/p/show?id=2309405361306445414478&/t6jp
weibo.com/ttarticle/p/show?id=2309405361307502379200&/va
weibo.com/ttarticle/p/show?id=2309405361308441903404&/7o
weibo.com/ttarticle/p/show?id=2309405361311801540679&/yka1
weibo.com/ttarticle/p/show?id=2309405361314007744729&/18m9
weibo.com/ttarticle/p/show?id=2309405361314544877750&/1ho
weibo.com/ttarticle/p/show?id=2309405361185594933357&/bpgc
weibo.com/ttarticle/p/show?id=2309405361185981071363&/pg4
weibo.com/ttarticle/p/show?id=2309405361186014625863&/t4ku
weibo.com/ttarticle/p/show?id=2309405361188761632793&/edck
weibo.com/ttarticle/p/show?id=2309405361188795449420&/pj
weibo.com/ttarticle/p/show?id=2309405361188963221629&/iplg
weibo.com/ttarticle/p/show?id=2309405361189411750003&/q3aj
weibo.com/ttarticle/p/show?id=2309405361227449892898&/3s6k
weibo.com/ttarticle/p/show?id=2309405361228053872732&/m581
weibo.com/ttarticle/p/show?id=2309405361228297142381&/8i
weibo.com/ttarticle/p/show?id=2309405361228742000945&/vy
weibo.com/ttarticle/p/show?id=2309405361228834013334&/158k
weibo.com/ttarticle/p/show?id=2309405361229026951241&/qrs6
weibo.com/ttarticle/p/show?id=2309405361262304821358&/qzpe
weibo.com/ttarticle/p/show?id=2309405361262346764298&/u6x
weibo.com/ttarticle/p/show?id=2309405361262380319012&/2kf
weibo.com/ttarticle/p/show?id=2309405361262451622077&/j0y
weibo.com/ttarticle/p/show?id=2309405361315023028285&/oct
weibo.com/ttarticle/p/show?id=2309405361316809801936&/nrf
weibo.com/ttarticle/p/show?id=2309405361317178638389&/brq
weibo.com/ttarticle/p/show?id=2309405361137771741229&/xds9
weibo.com/ttarticle/p/show?id=2309405361137838588514&/bc7e
weibo.com/ttarticle/p/show?id=2309405361137910154021&/5gcf
weibo.com/ttarticle/p/show?id=2309405361138228920407&/l3
weibo.com/ttarticle/p/show?id=2309405361130062348340&/ohk
weibo.com/ttarticle/p/show?id=2309405361130100359310&/yhlk
weibo.com/ttarticle/p/show?id=2309405361130473390648&/bxi
weibo.com/ttarticle/p/show?id=2309405361131069244001&/pf9p
weibo.com/ttarticle/p/show?id=2309405361132432130280&/v3w8
weibo.com/ttarticle/p/show?id=2309405361132541444285&/dqm
weibo.com/ttarticle/p/show?id=2309405361132616679824&/y2f1
weibo.com/ttarticle/p/show?id=2309405361132654428289&/b4t7
weibo.com/ttarticle/p/show?id=2309405361132687983241&/nle
weibo.com/ttarticle/p/show?id=2309405361133065732453&/z32
weibo.com/ttarticle/p/show?id=2309405361133346489091&/zh4
weibo.com/ttarticle/p/show?id=2309405361133527105665&/zj4w
weibo.com/ttarticle/p/show?id=2309405361120365379648&/5yc
weibo.com/ttarticle/p/show?id=2309405361120503791713&/1jzi
weibo.com/ttarticle/p/show?id=2309405361120683884576&/aero
weibo.com/ttarticle/p/show?id=2309405361121472413743&/j119
weibo.com/ttarticle/p/show?id=2309405361121611088016&/n18v
weibo.com/ttarticle/p/show?id=2309405361127008895502&/mqb
weibo.com/ttarticle/p/show?id=2309405361126975602714&/6sx
weibo.com/ttarticle/p/show?id=2309405361127273398828&/7y6
weibo.com/ttarticle/p/show?id=2309405361127310885476&/j4u0
weibo.com/ttarticle/p/show?id=2309405361127550223171&/8n3
weibo.com/ttarticle/p/show?id=2309405361127638302738&/67s
weibo.com/ttarticle/p/show?id=2309405361127835173212&/a4n
weibo.com/ttarticle/p/show?id=2309405361128040693972&/siz
weibo.com/ttarticle/p/show?id=2309405361101054541926&/ova
weibo.com/ttarticle/p/show?id=2309405361101851721743&/e7nc
weibo.com/ttarticle/p/show?id=2309405361102098923588&/61h
weibo.com/ttarticle/p/show?id=2309405361102203781293&/1qb6
weibo.com/ttarticle/p/show?id=2309405361103751741444&/7l1
weibo.com/ttarticle/p/show?id=2309405361103919513671&/b58
weibo.com/ttarticle/p/show?id=2309405361103793684520&/rrgc
weibo.com/ttarticle/p/show?id=2309405361104036954200&/zlpa
weibo.com/ttarticle/p/show?id=2309405361104212852922&/9wsb
weibo.com/ttarticle/p/show?id=2309405361104284156094&/m69j
weibo.com/ttarticle/p/show?id=2309405361104321904788&/r1j
weibo.com/ttarticle/p/show?id=2309405361105387257992&/grvu
weibo.com/ttarticle/p/show?id=2309405361105546903639&/5ru
weibo.com/ttarticle/p/show?id=2309405361105806950534&/zo
weibo.com/ttarticle/p/show?id=2309405361108625260591&/4ka
weibo.com/ttarticle/p/show?id=2309405361108839170192&/nqz
weibo.com/ttarticle/p/show?id=2309405361109233696894&/gw8
weibo.com/ttarticle/p/show?id=2309405361109468315726&/o2sf
weibo.com/ttarticle/p/show?id=2309405361109980283091&/36m
weibo.com/ttarticle/p/show?id=2309405361110131015688&/0re
weibo.com/ttarticle/p/show?id=2309405361112370774024&/kggj
weibo.com/ttarticle/p/show?id=2309405361112417173724&/o31
weibo.com/ttarticle/p/show?id=2309405360871626113137&/b19c
weibo.com/ttarticle/p/show?id=2309405360871772913769&/ocgj
weibo.com/ttarticle/p/show?id=2309405360871848673315&/4oy
weibo.com/ttarticle/p/show?id=2309405360871919976677&/h1dv
weibo.com/ttarticle/p/show?id=2309405360871957463164&/xl9y
weibo.com/ttarticle/p/show?id=2309405360872339144861&/d9m5
weibo.com/ttarticle/p/show?id=2309405360877066125404&/x1qd
weibo.com/ttarticle/p/show?id=2309405360877380698201&/k32
weibo.com/ttarticle/p/show?id=2309405360877922025607&/ixaa
weibo.com/ttarticle/p/show?id=2309405360878727069736&/moq
weibo.com/ttarticle/p/show?id=2309405360891448655990&/63
weibo.com/ttarticle/p/show?id=2309405360891523891225&/k6ca
weibo.com/ttarticle/p/show?id=2309405360891557707953&/oi
weibo.com/ttarticle/p/show?id=2309405360891708702724&/o24
weibo.com/ttarticle/p/show?id=2309405360891742257214&/t7
weibo.com/ttarticle/p/show?id=2309405361925851840587&/gris
weibo.com/ttarticle/p/show?id=2309405361925885657256&/e74
weibo.com/ttarticle/p/show?id=2309405361926099304487&/ou
weibo.com/ttarticle/p/show?id=2309405361926342574107&/pfg
weibo.com/ttarticle/p/show?id=2309405361926376390757&/u1h4
weibo.com/ttarticle/p/show?id=2309405361926414139445&/epyh
weibo.com/ttarticle/p/show?id=2309405361926678118582&/7axn
weibo.com/ttarticle/p/show?id=2309405361926720323715&/mzy
weibo.com/ttarticle/p/show?id=2309405361927659847713&/rzjj
weibo.com/ttarticle/p/show?id=2309405361928154775642&/gpch
weibo.com/ttarticle/p/show?id=2309405361929081454643&/j0sy
weibo.com/ttarticle/p/show?id=2309405361929295364286&/wyil
weibo.com/ttarticle/p/show?id=2309405361929630908554&/he
weibo.com/ttarticle/p/show?id=2309405361950896291920&/2mg
weibo.com/ttarticle/p/show?id=2309405361951097356304&/r6bi
weibo.com/ttarticle/p/show?id=2309405361951214796821&/zrbx
weibo.com/ttarticle/p/show?id=2309405361951252545585&/r773
weibo.com/ttarticle/p/show?id=2309405361951420579861&/m8
weibo.com/ttarticle/p/show?id=2309405361951659655335&/ers
weibo.com/ttarticle/p/show?id=2309405361951739084929&/kozc
weibo.com/ttarticle/p/show?id=2309405361951781290028&/8fo0
weibo.com/ttarticle/p/show?id=2309405361951936217145&/mpg
weibo.com/ttarticle/p/show?id=2309405361952288538729&/71
weibo.com/ttarticle/p/show?id=2309405361952452378760&/x9v
weibo.com/ttarticle/p/show?id=2309405361952494321740&/rwe
weibo.com/ttarticle/p/show?id=2309405361953622589596&/0qr3
weibo.com/ttarticle/p/show?id=2309405361953664532580&/xzr
weibo.com/ttarticle/p/show?id=2309405361953702019166&/ok5v
weibo.com/ttarticle/p/show?id=2309405361953899151503&/pjk2
weibo.com/ttarticle/p/show?id=2309405361954058534972&/wxz
回复

使用道具 赞 举报

高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 立即注册

1回帖数 0关注人数 12浏览人数
最后回复于:半小时前

社区

指南

AI

搜索

快速回复 返回顶部 返回列表