Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
5d6c8577
Commit
5d6c8577
authored
Dec 25, 2018
by
高雅喆
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add device_search_tag
parent
a6cbd3c8
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
14 deletions
+10
-14
EsmmData.scala
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
+10
-14
No files found.
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
View file @
5d6c8577
...
...
@@ -548,20 +548,16 @@ object GetDevicePortrait {
val
device_search_tag
=
sc
.
sql
(
s
"""
|select a.cl_id as device_id,COALESCE(a.params['diary_id'], a.params['business_id'], 0) as cid_id,split(c.level1_ids,',')[0] as level1_id
|from online.tl_hdfs_maidian_view as a
|left join
| (select cl_id as device_id,max(partition_date) as stat_date
| from online.tl_hdfs_maidian_view
| where action = 'on_click_diary_card'
| and (params['page_name']='search_result_diary' or params['page_name']='search_result_more')
| and partition_date > '20180601' group by cl_id) b
|on a.cl_id = b.device_id and a.partition_date=b.stat_date
|left join diary_feat c
|on COALESCE(a.params['diary_id'], a.params['business_id'], 0) = c.diary_id
|where a.partition_date > '20180601'
|and COALESCE(a.params['diary_id'], a.params['business_id'], 0) != 0
|and c.level1_ids != ""
|select
| a.cl_id as device_id,a.partition_date as stat_date,
| COALESCE(a.params['diary_id'], a.params['business_id'], 0) as cid_id,
| split(b.level1_ids,',')[0] as level1_id
|from online.tl_hdfs_maidian_view a
|left join diary_feat b
|on COALESCE(a.params['diary_id'], a.params['business_id'], 0) = b.diary_id
|where
| partition_date = '20181224'
| and (action = 'on_click_diary_card' or (action="full_stack_click_video_card_full_screen_play" and params["card_type"]="diary")))
"""
.
stripMargin
)
device_search_tag
.
show
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment