Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
d577dbc1
Commit
d577dbc1
authored
5 years ago
by
张彦钊
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
change test file
parent
2412d089
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
+3
-2
monitor.py
monitor.py
+3
-2
No files found.
monitor.py
View file @
d577dbc1
...
...
@@ -37,8 +37,8 @@ def Json(x):
#rdd transform
def
model
(
rdd
):
try
:
rdd
=
rdd
.
filter
(
lambda
x
:
Json
(
x
))
.
repartition
(
10
)
.
map
(
lambda
x
:
get_data
(
x
)
)
# .repartition(10
)
rdd
=
rdd
.
filter
(
lambda
x
:
Json
(
x
))
.
repartition
(
10
)
.
map
(
lambda
x
:
get_data
(
x
)
.
na
.
drop
()
.
groupByKey
())
\
.
map
(
lambda
x
:
write_redis
(
x
[
0
],
x
[
1
])
)
return
rdd
except
:
print
(
"fail"
)
...
...
@@ -81,6 +81,7 @@ def write_redis(device_id,cid_list):
else
:
r
.
set
(
key
,
json
.
dumps
(
cids
))
r
.
expire
(
key
,
7
*
24
*
60
*
60
)
return
"good"
except
Exception
as
e
:
print
(
"insert redis fail"
)
print
(
e
)
...
...
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment