Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
25c95f53
Commit
25c95f53
authored
Apr 12, 2019
by
王志伟
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
将百科id与tag关联
parent
81bd21ce
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
14 deletions
+9
-14
temp_analysis.scala
eda/feededa/src/main/scala/com/gmei/temp_analysis.scala
+9
-14
No files found.
eda/feededa/src/main/scala/com/gmei/temp_analysis.scala
View file @
25c95f53
...
@@ -718,28 +718,23 @@ object copy_database {
...
@@ -718,28 +718,23 @@ object copy_database {
val
stat_date
=
GmeiConfig
.
getMinusNDate
(
1
)
val
stat_date
=
GmeiConfig
.
getMinusNDate
(
1
)
// val stat_date=param.date
// val stat_date=param.date
val
partition_date
=
stat_date
.
replace
(
"-"
,
""
)
val
partition_date
=
stat_date
.
replace
(
"-"
,
""
)
val
copy_data
=
sc
.
sql
(
s
"""
|select *
|from online.tl_hdfs_wiki_item_tag_view
|where partition_date='${partition_date}'
"""
.
stripMargin
)
GmeiConfig
.
writeToJDBCTable
(
copy_data
,
"tl_hdfs_wiki_item_tag_view"
,
SaveMode
.
Overwrite
)
val
new_data
=
sc
.
sql
(
val
new_data
=
sc
.
sql
(
s
"""
s
"""
|select a.item_id,a.tag_id,b.id,b.name,b.treatment_method,b.price_min,b.price_max,b.treatment_time,b.maintain_time,b.recover_time
|select d.level2_id,d.level2_name,c.item_id,c.tag_id,c.id,c.name,c.treatment_method,c.price_min,c.price_max,c.treatment_time,c.maintain_time,c.recover_time
|from tl_hdfs_wiki_item_tag_view a
|from online.bl_tag_hierarchy_detail d
|inner join
|(select a.item_id,a.tag_id,b.id,b.name,b.treatment_method,b.price_min,b.price_max,b.treatment_time,b.maintain_time,b.recover_time
|from online.tl_hdfs_wiki_item_tag_view a
|inner join Knowledge_network b
|inner join Knowledge_network b
|on a.item_id=b.id
|on a.item_id=b.id
|where a.partition_date='${partition_date}'
|where a.partition_date='${partition_date}') c
|on d.id=c.tag_id
|where d.partition_date='${partition_date}'
"""
.
stripMargin
"""
.
stripMargin
)
)
GmeiConfig
.
writeToJDBCTable
(
new_data
,
"Knowledge_network_data"
,
SaveMode
.
Overwrite
)
GmeiConfig
.
writeToJDBCTable
(
new_data
,
"
train_
Knowledge_network_data"
,
SaveMode
.
Overwrite
)
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment