Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
a704e2fd
Commit
a704e2fd
authored
Apr 29, 2019
by
张彦钊
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add distinct
parent
42a5684a
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
multi.py
tensnsorflow/multi.py
+2
-2
No files found.
tensnsorflow/multi.py
View file @
a704e2fd
...
...
@@ -19,7 +19,7 @@ def app_list_func(x,l):
def
multi_hot
(
df
,
column
,
n
):
v
=
set
(
df
.
select
(
column
)
.
rdd
.
map
(
lambda
x
:
x
[
0
])
.
collect
()
)
v
=
df
.
select
(
column
)
.
distinct
()
.
rdd
.
map
(
lambda
x
:
x
[
0
])
.
collect
(
)
app_list_value
=
[
i
.
split
(
","
)
for
i
in
v
]
app_list_unique
=
[]
for
i
in
app_list_value
:
...
...
@@ -81,7 +81,7 @@ def feature_engineer():
unique_values
=
[]
for
i
in
features
:
unique_values
.
extend
(
list
(
set
(
df
.
select
(
i
)
.
rdd
.
map
(
lambda
x
:
x
[
0
])
.
collect
())
))
unique_values
.
extend
(
df
.
select
(
i
)
.
distinct
()
.
rdd
.
map
(
lambda
x
:
x
[
0
])
.
collect
(
))
temp
=
list
(
range
(
2
+
apps_number
+
level2_number
+
level3_number
,
2
+
apps_number
+
level2_number
+
level3_number
+
len
(
unique_values
)))
value_map
=
dict
(
zip
(
unique_values
,
temp
))
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment