Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
416eb3a4
Commit
416eb3a4
authored
Nov 20, 2018
by
王志伟
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
去除机构和黑名单
parent
8dea0587
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
3 deletions
+3
-3
GmeiConfig.scala
eda/feededa/src/main/scala/com/gmei/GmeiConfig.scala
+1
-1
app_list.scala
eda/feededa/src/main/scala/com/gmei/app_list.scala
+2
-2
No files found.
eda/feededa/src/main/scala/com/gmei/GmeiConfig.scala
View file @
416eb3a4
...
...
@@ -34,7 +34,7 @@ object GmeiConfig extends Serializable {
val
sparkConf
=
new
SparkConf
sparkConf
.
set
(
"spark.sql.crossJoin.enabled"
,
"true"
)
sparkConf
.
set
(
"spark.debug.maxToStringFields"
,
"100"
)
sparkConf
.
set
(
"spark.sql.broadcastTimeout"
,
"
1
000"
)
sparkConf
.
set
(
"spark.sql.broadcastTimeout"
,
"
6
000"
)
if
(!
sparkConf
.
contains
(
"spark.master"
))
{
sparkConf
.
setMaster
(
"local[3]"
)
...
...
eda/feededa/src/main/scala/com/gmei/app_list.scala
View file @
416eb3a4
...
...
@@ -319,7 +319,7 @@ object coincidence_xinyang {
meigou_pay_device_all
.
show
()
//截止目前获得的与新氧重合的用户数咨询统计
/*
val zixun_num_all = sc.sql(
val
zixun_num_all
=
sc
.
sql
(
s
"""
|select count(cl_id) as zixun_num_all
|from online.tl_hdfs_maidian_view
...
...
@@ -342,7 +342,7 @@ object coincidence_xinyang {
"""
.
stripMargin
)
zixun_device_all
.
show
()
*/
val
zixun_num_co
=
sc
.
sql
(
s
"""
|select count(cl_id) as zixun_num_co
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment