Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
d4ba9992
Commit
d4ba9992
authored
Nov 01, 2018
by
王志伟
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
change sql
parent
62841705
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
6 deletions
+8
-6
testt.scala
eda/feededa/src/main/scala/com/gmei/testt.scala
+8
-6
No files found.
eda/feededa/src/main/scala/com/gmei/testt.scala
View file @
d4ba9992
...
...
@@ -47,18 +47,20 @@ object testt {
ti
.
tidbMapTable
(
dbName
=
"jerry_prod"
,
tableName
=
"blacklist"
)
ti
.
tidbMapTable
(
dbName
=
"jerry_test"
,
tableName
=
"bl_device_list"
)
ti
.
tidbMapTable
(
dbName
=
"jerry_prod"
,
tableName
=
"data_feed_exposure"
)
ti
.
tidbMapTable
(
dbName
=
"online"
,
tableName
=
"tl_hdfs_maidian_view"
)
val
strategies
=
Seq
(
"3$"
,
"4$"
,
"5$"
,
"6$"
,
"7$"
,
"8$"
,
"c$"
,
"d$"
,
"e$"
,
"A$"
,
"B$"
,
"C$"
,
"D$"
)
for
(
strategy
<-
strategies
){
println
(
strategy
)
val
get_data_dura
=
sc
.
sql
(
s
"""
|select count(cid_id) as get_clk_count_newUser
|from data_feed_click
|where (cid_type = 'diary' or cid_type = 'diary_video')
|and device_id regexp'${strategy}'
|and device_id not in (select device_id from bl_device_list)
|and device_id not in (select device_id from blacklist)
|select partition_date, sum(params['duration']) as total_dur,count(distinct(cl_id)) as num
|from online.tl_hdfs_maidian_view
|where action="on_app_session_over"
|and cl_id regexp'${strategy}'
|and params['duration']>=0 and params['duration']<86400
|and partition_date >='20180801'
|group by partition_date order by partition_date desc
"""
.
stripMargin
)
get_data_dura
.
show
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment