Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
a2403e55
Commit
a2403e55
authored
6 years ago
by
高雅喆
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
rm write to local csv since permission denied
parent
23641909
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
8 deletions
+4
-8
WeafareStat.scala
eda/feededa/src/main/scala/com/gmei/WeafareStat.scala
+4
-8
No files found.
eda/feededa/src/main/scala/com/gmei/WeafareStat.scala
View file @
a2403e55
...
@@ -123,14 +123,10 @@ object WeafareStat {
...
@@ -123,14 +123,10 @@ object WeafareStat {
.
join
(
txt_clk_count
,
"stat_date"
)
.
join
(
txt_clk_count
,
"stat_date"
)
.
join
(
txt_meigou_count
,
"stat_date"
)
.
join
(
txt_meigou_count
,
"stat_date"
)
result
.
withColumn
(
"video_rate"
,
result
.
col
(
"video_meigou_count"
)/
result
.
col
(
"video_clk_count"
))
val
result1
=
result
.
withColumn
(
"video_rate"
,
result
.
col
(
"video_meigou_count"
)/
result
.
col
(
"video_clk_count"
))
result
.
withColumn
(
"txt_rate"
,
result
.
col
(
"txt_meigou_count"
)/
result
.
col
(
"txt_clk_count"
))
val
result2
=
result
.
withColumn
(
"txt_rate"
,
result
.
col
(
"txt_meigou_count"
)/
result
.
col
(
"txt_clk_count"
))
result
.
show
()
result2
.
show
()
val
output
=
"/data2/model/eda/gray_stat/welfare_detail_count_fromvideo.csv"
result
.
repartition
(
1
)
.
write
.
format
(
"com.databricks.spark.csv"
)
.
option
(
"header"
,
"true"
).
save
(
output
)
sc
.
stop
()
sc
.
stop
()
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment