Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
dab2a1cf
Commit
dab2a1cf
authored
Sep 27, 2019
by
张彦钊
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add
parent
45302231
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
24 additions
and
4 deletions
+24
-4
hello.py
hello.py
+24
-4
No files found.
hello.py
View file @
dab2a1cf
...
...
@@ -41,13 +41,33 @@ if __name__ == '__main__':
# # df.show(6)
# # params['exposure_cards'],
df
.
persist
()
total
=
[]
rdd
=
df
.
rdd
.
map
(
lambda
x
:(
"a"
,
position
(
eval
(
x
[
0
]),
10
)))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
print
(
"<=10"
)
print
(
rdd
.
collect
()[
0
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
rdd
=
df
.
rdd
.
map
(
lambda
x
:
(
"a"
,
position
(
eval
(
x
[
0
]),
30
)))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
rdd
=
df
.
rdd
.
map
(
lambda
x
:
(
"a"
,
position
(
eval
(
x
[
0
]),
50
)))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
rdd
=
df
.
rdd
.
map
(
lambda
x
:
(
"a"
,
cpc
(
eval
(
x
[
0
]),
10
)))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
print
(
"<=10 cpc ==1 "
)
print
(
rdd
.
collect
()[
0
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
rdd
=
df
.
rdd
.
map
(
lambda
x
:
(
"a"
,
cpc
(
eval
(
x
[
0
]),
30
)))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
rdd
=
df
.
rdd
.
map
(
lambda
x
:
(
"a"
,
cpc
(
eval
(
x
[
0
]),
50
)))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
rdd
=
df
.
rdd
.
map
(
lambda
x
:
(
"a"
,
len
(
eval
(
x
[
0
]))))
.
reduceByKey
(
lambda
x
,
y
:
x
+
y
)
.
map
(
lambda
x
:
x
[
1
])
tmp
=
rdd
.
collect
()[
0
]
total
.
append
(
tmp
)
df
.
unpersist
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment