Skip to content
Toggle navigation
Toggle navigation
This project
Loading...
Sign in
张浩
/
BrBigDataTest
Go to a project
Toggle navigation
Toggle navigation pinning
Projects
Groups
Snippets
Help
Project
Activity
Repository
Pipelines
Graphs
Issues
0
Merge Requests
0
Wiki
Network
Create a new issue
Builds
Commits
Issue Boards
Files
Commits
Network
Compare
Branches
Tags
Commit
74091e12
...
74091e1214353e64dbb28827cb877de0dcb61146
authored
2022-01-18 16:37:35 +0800
by
张浩
Browse Files
Options
Browse Files
Tag
Download
Email Patches
Plain Diff
commit
1 parent
16469151
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
11 deletions
run_linux.sh
shell/biz_data_count.hql
shell/biz_data_response.hql
run_linux.sh
View file @
74091e1
...
...
@@ -10,13 +10,8 @@ sleep 3
hive -f ./shell/load_data.hql
hive -f ./shell/method_count.hql
method
=
$(
hive -f ./shell/method_select.hql
)
for
tmp
in
$method
do
hive -hivevar
mytemp
=
$tmp
-f ./shell/biz_data_count.hql
hive -hivevar
mytemp
=
$tmp
-f ./shell/biz_data_response.hql
done
hive -f ./shell/biz_data_count.hql
hive -f ./shell/biz_data_response.hql
hadoop fs -rm /input/data/
$time
rm ../
$time
...
...
shell/biz_data_count.hql
View file @
74091e1
use testdb;
INSERT
INTO
TABLE biz_data_count
INSERT
OVERWRITE
TABLE biz_data_count
select method,biz_data,count(1) as count,max(timestamp) as timestamp
from qa_log
where method is not null and method!='N/A'
and method='${hivevar:mytemp}'
where method is not null and method!='N/A'
group by method,biz_data;
\ No newline at end of file
...
...
shell/biz_data_response.hql
View file @
74091e1
use testdb;
INSERT
INTO
TABLE biz_data_response
INSERT
OVERWRITE
TABLE biz_data_response
select method,biz_data,uid,timestamp,response
from qa_log
where method is not null and method!='N/A' and method='${hivevar:mytemp}';
\ No newline at end of file
where method is not null and method!='N/A';
\ No newline at end of file
...
...
Please
register
or
sign in
to post a comment