Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
B
bi-report
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
data
bi-report
Commits
e76aee5c
Commit
e76aee5c
authored
Apr 26, 2020
by
赵建伟
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update codes
parent
e87e6ee2
Hide whitespace changes
Inline
Side-by-side
Showing
7 changed files
with
12 additions
and
12 deletions
+12
-12
README.md
docs/README.md
+1
-1
demo.zip
jobs/demo/demo.zip
+0
-0
hive2csv.sh
lib/shell/hive2csv.sh
+2
-2
hive2hive.sh
lib/shell/hive2hive.sh
+2
-2
sparksql2csv.sh
lib/shell/sparksql2csv.sh
+2
-2
sparksql2email.sh
lib/shell/sparksql2email.sh
+2
-2
waitsuccess.sh
lib/shell/waitsuccess.sh
+3
-3
No files found.
docs/README.md
View file @
e76aee5c
...
...
@@ -21,5 +21,5 @@ BI report project init.
####mkdir -p /data/bi-report/tmp
####mkdir -p /data/bi-report/result
####mkdir -p /data/bi-report/logs
####chown -R
hadoop:hadoop
/data/bi-report
####chown -R
bi:bi
/data/bi-report
jobs/demo/demo.zip
0 → 100644
View file @
e76aee5c
File added
lib/shell/hive2csv.sh
View file @
e76aee5c
...
...
@@ -57,4 +57,4 @@ sed -i "s/\$V_7DAY_M_D_AGO/$V_7DAY_M_D_AGO/g" $tmp_file_name
/opt/hive/hive-1.1.0-cdh5.16.1/bin/beeline
-u
jdbc:hive2://bj-gm-prod-cos-datacenter004:10000
-n
data
--outputformat
=
csv2
--showHeader
=
true
-e
"
`
cat
$tmp_file_name
`
"
>
$result_file_name
rm
-rf
$tmp_file_name
exit
0
\ No newline at end of file
exit
$?
\ No newline at end of file
lib/shell/hive2hive.sh
View file @
e76aee5c
...
...
@@ -55,4 +55,4 @@ sed -i "s/\$V_7DAY_M_D_AGO/$V_7DAY_M_D_AGO/g" $tmp_file_name
/opt/hive/hive-1.1.0-cdh5.16.1/bin/beeline
-u
jdbc:hive2://bj-gm-prod-cos-datacenter004:10000
-n
data
-e
"
`
cat
$tmp_file_name
`
"
rm
-rf
$tmp_file_name
exit
0
\ No newline at end of file
exit
$?
\ No newline at end of file
lib/shell/sparksql2csv.sh
View file @
e76aee5c
...
...
@@ -54,4 +54,4 @@ sed -i "s/\$V_7DAY_M_D_AGO/$V_7DAY_M_D_AGO/g" tmp.sql
/opt/spark/spark-2.4.5-bin-hadoop2.7/bin/beeline
-u
jdbc:hive2://bj-gm-prod-cos-datacenter003:10010/online
-n
data
--outputformat
=
csv2
--showHeader
=
true
-e
"
`
cat
tmp.sql
`
"
>
$2
rm
-rf
tmp.sql
exit
0
\ No newline at end of file
exit
$?
\ No newline at end of file
lib/shell/sparksql2email.sh
View file @
e76aee5c
...
...
@@ -65,4 +65,4 @@ echo "cc: "$cc
python2.7 /home/bi/bi-report/lib/python/sendmail.py
-t
$to
-s
自动发送
-m
$cc
-a
$result_file_name
exit
0
\ No newline at end of file
exit
$?
\ No newline at end of file
lib/shell/waitsuccess.sh
View file @
e76aee5c
...
...
@@ -10,5 +10,6 @@ export DB=$2
export
TABLE
=
$3
export
PARTITIONS
=
$4
res
=
`
/bin/bash /srv/apps/data-ready-checker/client/bin/checker.sh
`
#echo $res
\ No newline at end of file
/bin/bash /srv/apps/data-ready-checker/client/bin/checker.sh
exit
$?
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment