Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
8907f684
Commit
8907f684
authored
Mar 14, 2019
by
张彦钊
Browse files
Options
Browse Files
Download
Plain Diff
Merge branch 'master' of git.wanmeizhensuo.com:ML/ffm-baseline
add eda file
parents
ae16b6d6
35fd01fc
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
7 deletions
+8
-7
temp_analysis.scala
eda/feededa/src/main/scala/com/gmei/temp_analysis.scala
+8
-7
No files found.
eda/feededa/src/main/scala/com/gmei/temp_analysis.scala
View file @
8907f684
...
...
@@ -784,34 +784,35 @@ object bug_again_count {
val
spam_order_id
=
sc
.
sql
(
s
"""
|select
distinc
t(order_id)
|select
coun
t(order_id)
|from mining.ml_order_spam_recognize
|where partition_date='${partition_date}'
"""
.
stripMargin
)
spam_order_id
.
createOrReplaceTempView
(
"spam_order_id"
)
spam_order_id
.
show
()
val
meigou_id_order
=
sc
.
sql
(
s
"""
|select
a.user_id from (select
od.user_id,count(od.order_id) as order_num
|from online.ml_meigou_order_detail od left join spam_order_id
|select od.user_id,count(od.order_id) as order_num
|from online.ml_meigou_order_detail
od left join spam_order_id
|on od.order_id=spam_order_id.order_id
|where od.status=
'2'
|where od.status=
"2"
|and od.partition_date='${partition_date}'
|and spam_order_id.order_id is null
|group by od.user_id
|order by order_num) a
|where a.order_num>=2
|order by order_num
"""
.
stripMargin
)
meigou_id_order
.
createOrReplaceTempView
(
"meigou_id_order"
)
meigou_id_order
.
show
()
val
diary_id
=
sc
.
sql
(
s
"""
|select sd.id,sd.user_id
|from src_mimas_prod_api_diary sd inner join meigou_id_order
|on sd.user_id=meigou_id_order.user_id
|where sd.content_level>=
'3.5'
|where sd.content_level>=
"3.5"
"""
.
stripMargin
)
diary_id
.
show
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment