Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
62ebe104
Commit
62ebe104
authored
Dec 29, 2018
by
高雅喆
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add sortbykey
parent
891aee74
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
EsmmData.scala
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
+4
-1
No files found.
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
View file @
62ebe104
...
...
@@ -655,7 +655,10 @@ object GetLevelCount {
diary_level1
.
show
()
println
(
diary_level1
.
count
())
val
level1_count
=
diary_level1
.
rdd
.
map
(
x
=>
(
x
(
1
).
toString
)).
map
(
level1
=>
(
level1
,
1
)).
reduceByKey
((
a
,
b
)
=>
a
+
b
).
map
(
p
=>
(
p
.
_1
,
p
.
_2
)).
sortByKey
(
false
,
2
)
val
cid_xiong
=
diary_level1
.
rdd
.
filter
(
_
.
getAs
(
"diary_feat"
)==
7
)
cid_xiong
.
collect
().
foreach
(
println
)
val
level1_count
=
diary_level1
.
rdd
.
map
(
x
=>
(
x
(
1
).
toString
)).
map
(
level1
=>
(
level1
,
1
)).
reduceByKey
((
a
,
b
)
=>
a
+
b
).
sortBy
(
_
.
_2
,
false
)
level1_count
.
collect
().
foreach
(
println
)
println
(
level1_count
.
count
())
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment