Skip to content

F
ffm-baseline
Commit eb909ed6 authored by 高雅喆's avatar 高雅喆
Browse files
Options

drop duplicate

parent 99b7a9b0
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
eda/feededa/src/main/scala/com/gmei/EsmmData.scala
View file @ eb909ed6
...@@ -585,7 +585,7 @@ object GetDevicePortrait { ...@@ -585,7 +585,7 @@ object GetDevicePortrait {
// println(max_count_tag.count()) // println(max_count_tag.count())
//drop duplicates //drop duplicates
val max_count_tag_rdd = max_count_tag.rdd.groupBy(_.getAs[String("device_id")).map { val max_count_tag_rdd = max_count_tag.rdd.groupBy(_.getAs[String]("device_id")).map {
case (device_id,data) => case (device_id,data) =>
val stat_date = data.map(_.getAs[String]("stat_date")).head val stat_date = data.map(_.getAs[String]("stat_date")).head
val max_level1_id = data.map(_.getAs[String]("max_level1_id")).head val max_level1_id = data.map(_.getAs[String]("max_level1_id")).head
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment