Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
5231ef19
Commit
5231ef19
authored
Dec 20, 2018
by
高雅喆
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
bug fix
parent
6c231f61
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
8 deletions
+9
-8
EsmmData.scala
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
+9
-8
No files found.
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
View file @
5231ef19
...
@@ -472,22 +472,23 @@ object GetPortrait {
...
@@ -472,22 +472,23 @@ object GetPortrait {
val
ti
=
new
TiContext
(
sc
)
val
ti
=
new
TiContext
(
sc
)
ti
.
tidbMapTable
(
dbName
=
"jerry_prod"
,
tableName
=
"data_feed_click"
)
ti
.
tidbMapTable
(
dbName
=
"jerry_prod"
,
tableName
=
"data_feed_click"
)
val
stat_date
=
param
.
date
val
diary_tag
=
sc
.
sql
(
val
diary_tag
=
sc
.
sql
(
s
"""
s
"""
|select d.diary_id,
|select d.diary_id,
|
(case when d.tag_type = '1' then d.level1_ids else "" end
) level1_ids,
|
if(d.tag_type = '1',d.level1_ids,""
) level1_ids,
|
(case when d.tag_type = '2' then d.level2_ids else "" end
) level2_ids,
|
if(d.tag_type = '2',d.level2_ids,""
) level2_ids,
|
(case when d.tag_type = '3' then d.level3_ids else "" end
) level3_ids from
|
if(d.tag_type = '3',d.level3_ids,""
) level3_ids from
| (select c.diary_id,c.tag_type,
| (select c.diary_id,c.tag_type,
| concat_ws(
c.level1_id) as level1_ids
| concat_ws(
',',collect_set(cast(c.level1_id as string))) as level1_ids,
| concat_ws(
c.level2_id) as level2_ids
| concat_ws(
',',collect_set(cast(c.level2_id as string))) as level2_ids,
| concat_ws(
c.level3_id
) as level3_ids from
| concat_ws(
',',collect_set(cast(c.level3_id as string))
) as level3_ids from
| (select a.diary_id,a.tag_id,b.tag_type,b.level1_id,b.level2_id,b.level3_id
| (select a.diary_id,a.tag_id,b.tag_type,b.level1_id,b.level2_id,b.level3_id
| from tl_hdfs_diary_tags_view a
| from tl_hdfs_diary_tags_view a
| left join bl_tag_hierarchy_detail b
| left join bl_tag_hierarchy_detail b
| on a.tag_id = b.id
| on a.tag_id = b.id
| where a.partition_date = '
20181218
'
| where a.partition_date = '
${stat_date}
'
| and b.partition_date = '
20181218
') c
| and b.partition_date = '
${stat_date}
') c
| group by c.diary_id,c.tag_type) d
| group by c.diary_id,c.tag_type) d
|group by d.diary_id
|group by d.diary_id
"""
.
stripMargin
"""
.
stripMargin
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment