Streamis application initialization supports online application import and versioning - #67

Open

jefftlin wants to merge 650 commits into

WeBankFinTech:dev-0.2.5from

WeDataSphere:dev-0.2.5-job-version

This pull request is big! We're only showing the most recent 250 commits

Commits on Mar 1, 2022

Add mysql connector jar.
green241
committed
3d55c1e
Set upload zip file size to 500MB.（Sometimes the fat package built by flink will be larger）
green241
committed
c0be1a0
Merge pull request #14 from green241/main
wushengyeyouya
authored
617eae6

Commits on Mar 2, 2022

Commits on Mar 7, 2022

modify stoped to stopped
sihy
committed
559837e

Commits on Apr 1, 2022

Fix the problem that method call in circle.
wushengyeyouya
committed
9c458d4
Merge remote-tracking branch 'origin/main' into main
wushengyeyouya
committed
7ecd67f

Commits on Apr 6, 2022

Add support of extra flink configs.
wushengyeyouya
committed
95d36a5

Commits on Apr 17, 2022

Commits on Apr 18, 2022

Adjust the streamis_ddl.sql to accept large value of field
Davidhua1996
committed
66ab96c

Commits on May 5, 2022

Redefine the project file regex; Filter and replace the specific parameters that with blank character in job.
Davidhua1996
committed
37faddf

Commits on May 10, 2022

Commits on May 11, 2022

feat: 【前端】流式应用的 Yarn 执行日志展示
kaviarpan
committed
c25fdb0
feat: modify detail tab i18n
kaviarpan
committed
f81ad9e
add streamis Appconn
v_xiangbiaowu
committed
2d7ffa8
Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis into dev-0.2.0
v_xiangbiaowu
committed
1ea2c62

Commits on May 12, 2022

feat: 初步写下前端逻辑，还剩进度条
kaviarpan
committed
7b52f8b
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
kaviarpan
committed
e25ee11
update streamis Appconn
v_xiangbiaowu
committed
54177a8

Commits on May 13, 2022

Commits on May 15, 2022

Adjust the module of job launcher for Linkis.
Davidhua1996
committed
58bbf27

Commits on May 16, 2022

Note the progress of AbstractLinkisJobStateFetcher
Davidhua1996
committed
a26e008
feat: fake some code
kaviarpan
committed
7dead32
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
kaviarpan
committed
e4eada6
fix: forget to change the test code
kaviarpan
committed
6b28a2a
feat: temporarily create test.vue
kaviarpan
committed
b13ddce
update streamis Appconn
v_xiangbiaowu
committed
bc09b6b
Merge remote-tracking branch 'origin/dev-0.2.0' into dev-0.2.0
v_xiangbiaowu
committed
66341a6

Commits on May 17, 2022

Commits on May 18, 2022

Get the Checkpoint file information
v_xiangbiaowu
committed
2e4f65c
Get the Checkpoint file information, update exception handling
v_xiangbiaowu
committed
e3379f5

Commits on May 19, 2022

request parater validation
v_xiangbiaowu
committed
30c8c7a
Streamis scheduler module and Reconstruct the TaskService class (50%)
Davidhua1996
committed
98b5ed3
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
4024d88

Commits on May 20, 2022

update Get the Checkpoint file information
v_xiangbiaowu
committed
7fec466
Resolve the JobStateResult.java compilation issues
v_xiangbiaowu
committed
b13216f

Commits on May 23, 2022

Reconstruct the TaskService (100%); Bulk operation for job; Make the JobLaunchManager stateless; New JobConfRestfulApi;
Davidhua1996
committed
3b840cd
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
620c57c
feat: complete the i18n config
kaviarpan
committed
e70a06f
feat: complete the logic of batch restart
kaviarpan
committed
0fc7733
feat: no need for jobid
kaviarpan
committed
b3a99ac
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
kaviarpan
committed
c14560f

Commits on May 24, 2022

feat: the function of job list ready
kaviarpan
committed
4a1b837
feat: config还有点问题，先遗留
kaviarpan
committed
317ac59
fix: the child_def array empty problem
kaviarpan
committed
90cd350

Commits on May 25, 2022

feat: improve the functions comment by DH
kaviarpan
committed
67a09b0
feat: improve style
kaviarpan
committed
b104ec9
fix: logic error
kaviarpan
committed
964ec7b
fix: bugs
kaviarpan
committed
5d842d6
fix: splice bug
kaviarpan
committed
a838c0c
feat: hide the extra checkbox
kaviarpan
committed
3c1d44e
feat: multi key warning
kaviarpan
committed
2a12edd
feat: add savepoint cgi and change the button load
kaviarpan
committed
753ec0b

Commits on May 26, 2022

fix: remained bugs
kaviarpan
committed
3e0c9d3
feat: snapshot path & logs history problems
kaviarpan
committed
fae8f0f
fix: several warnings
kaviarpan
committed
3a5a34c
feat: savepoint modal
kaviarpan
committed
df36b33
fix: endline logic problem
kaviarpan
committed
2759cb2
Strategy to fetch the JobState from Linkis server.
Davidhua1996
committed
2e89881
Fix the compilation problem in modules.
Davidhua1996
committed
44bb659
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
b9f68fa
feat: validate configs
kaviarpan
committed
14b8e8b
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
kaviarpan
committed
c317559
feat: delete the extra logic
kaviarpan
committed
cbf8e0f

Commits on May 30, 2022

fix: the cognition bugs
kaviarpan
committed
93197cd
adjust appconn
v_xiangbiaowu
committed
558fbf1
init projectPrivilege
v_xiangbiaowu
committed
7ed3412
Merge remote-tracking branch 'origin/dev-0.2.0' into dev-0.2.0
v_xiangbiaowu
committed
4a17a62

Commits on May 31, 2022

Reconstruct the configuration module; Adjust the log4j2.xml
Davidhua1996
committed
dae49ba
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
3615af9
Project Privilege Update
v_xiangbiaowu
committed
78d6b03
Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis into dev-0.2.0
v_xiangbiaowu
committed
78bd170

Commits on Jun 2, 2022

AppConn Update
v_xiangbiaowu
committed
390979f

Commits on Jun 6, 2022

Commits on Jun 7, 2022

Store the linkis job id when the launched job has failed.
Davidhua1996
committed
ef06697

Commits on Jun 8, 2022

AppConn related table update
v_xiangbiaowu
committed
15d6bb0
Flink the problem in JobRestfulApi; Enable to set flink application name in FlinkJobLaunchManager.
Davidhua1996
committed
acd945d
Upgrade the .gitignore file
Davidhua1996
committed
1d92838
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
742ea5d
privilege manage update
v_xiangbiaowu
committed
cacedcd
Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis into dev-0.2.0
v_xiangbiaowu
committed
0c0141e
resolving injection conflicts
v_xiangbiaowu
committed
aa83b42

Commits on Jun 10, 2022

project privilege change
v_xiangbiaowu
committed
b877448
project privilege change
v_xiangbiaowu
committed
e3822fc

Commits on Jun 13, 2022

project privilege change
v_xiangbiaowu
committed
ba3b8cc
appconn init DDL update
v_xiangbiaowu
committed
5cc3c17
Adjust the stream job service and the strategy of data authority.
Davidhua1996
committed
e6e0cda
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
a7fbd89
Resolve the conflict in Job service.
Davidhua1996
committed
c581adf
bug repair
v_xiangbiaowu
committed
4e2f185
bug repair
v_xiangbiaowu
committed
26daf23
adjusting privilefe service
v_xiangbiaowu
committed
239fe45

Commits on Jun 14, 2022

bug repair 277118
v_xiangbiaowu
committed
925f454
Modify the assembly configuration of streamis Appconn.
Davidhua1996
committed
e45d65a
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
Davidhua1996
committed
c6b7005
bug repair 277133
v_xiangbiaowu
committed
303d32b
Consider the situation of no matched configuration in web page
Davidhua1996
committed
c32a610
Enable the developer to update/insert the configuration of users; Attach the tenant label to streamis job; Enable to store the undefined configuration pairs.
Davidhua1996
committed
9d31291
Adjust the streamis_ddl.sql
Davidhua1996
committed
1a8e49a
Adjust the streamis_ddl.sql to accept large value of field
Davidhua1996
committed
42ca2d5
Redefine the project file regex; Filter and replace the specific parameters that with blank character in job.
Davidhua1996
committed
31666cb
Roll the version to "0.2.0"; Change the dependency version of linkis and dss to "1.1.0" and "1.1.3"
Davidhua1996
committed
e8b42bf
Init the streamis AppConn
Davidhua1996
committed
ee26e7b
add streamis Appconn

v_xiangbiaowu
authored and
Davidhua1996
committed
ebc174b
update streamis Appconn

v_xiangbiaowu
authored and
Davidhua1996
committed
7316f17
Adjust dependency and structure of the job launcher module and add JobState interface
Davidhua1996
committed
baddb04

Commits on Jun 16, 2022

Commits on Jun 22, 2022

Reduce the duplicated dependencies of streamis-appconn
Davidhua1996
committed
cb3ceb2
update DeleteOperation and UpdateOperation Generic type
v_xiangbiaowu
committed
26a6464
Revert "[Feature] JobState component in launcher module"
Davidhua1996
authored
7fbf733
adjust pom
v_xiangbiaowu
committed
f66fd2e
Merge pull request #27 from WeBankFinTech/revert-25-dev-0.2.0-jobstate-interface
wushengyeyouya
authored
5ef453c
Sync the latest ddl and dml sql for streamis
Davidhua1996
committed
cbd43ae

Commits on Jun 23, 2022

Remove the useless restful/mybatis configuration
Davidhua1996
committed
474b197
Merge branch 'dev-0.2.0' of github.com:WeBankFinTech/Streamis into dev-0.2.0
Davidhua1996
committed
e509121
Merge remote-tracking branch 'wedata/dev-0.2.0-webank' into dev-0.2.0
Davidhua1996
committed
9cf23b7
update init.sql ip port
v_xiangbiaowu
committed
d7f41ab
Merge remote-tracking branch 'origin/dev-0.2.0-webank' into dev-0.2.0-webank
v_xiangbiaowu
committed
c4e9799
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
Davidhua1996
committed
dc57a33

Commits on Jun 24, 2022

Merge pull request #28 from WeDataSphere/dev-0.2.0
Davidhua1996
authored
21a8acf
Merge pull request #29 from WeBankFinTech/dev-0.2.0
wushengyeyouya
authored
30a4351
update init.sql IP PORT
v_xiangbiaowu
committed
85903aa
StreamisAppConnDesignDocument
v_xiangbiaowu
committed
a8c85db

Commits on Jun 25, 2022

update web project version、 config.sh project version and project-server pom
v_xiangbiaowu
committed
a0feda4
Streamis安装文档
v_xiangbiaowu
committed
ffe496c

Commits on Jun 27, 2022

Merge branch 'dev-0.2.0-webank' into dev-0.2.0
v_xiangbiaowu
committed
e2370de
fix: the diy config problem
kaviarpan
committed
6a471fd
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev-0.2.0
kaviarpan
committed
a1a5a59
Merge pull request #30 from WeDataSphere/dev-0.2.0
Davidhua1996
authored
5afe230
Remove StreamSQL development menu in DSS
v_xiangbiaowu
committed
7328b03
Optimize install.sh
v_xiangbiaowu
committed
4734eee
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
v_xiangbiaowu
committed
e0ed4ce

Commits on Jun 28, 2022

Optimize Streamis installation documentation
v_xiangbiaowu
committed
1c3535d
Merge pull request #26 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996
authored
c1b5f85
Solve the problem of no loss of Streamis Product Center
v_xiangbiaowu
committed
45658a0
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
v_xiangbiaowu
committed
b37ad25
update installation documentation
v_xiangbiaowu
committed
efc73f2

Commits on Jun 29, 2022

Merge pull request #31 from WeBankFinTech/dev-0.2.0
Davidhua1996
authored
25cd526
Merge pull request #32 from WeDataSphere/dev-0.2.0
Davidhua1996
authored
037b0c5
Merge pull request #34 from WeBankFinTech/dev-0.2.0
Davidhua1996
authored
edf462a
update insert dss_workspace_dictionary table
v_xiangbiaowu
committed
75dc711
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
v_xiangbiaowu
committed
2db2847
Merge pull request #35 from WeDataSphere/dev-0.2.0
Davidhua1996
authored
1e042ef
Merge pull request #36 from WeBankFinTech/dev-0.2.0
Davidhua1996
authored
bc7a52e

Commits on Jun 30, 2022

use document
v_xiangbiaowu
committed
cd062ac

Commits on Jul 1, 2022

Merge pull request #33 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996
authored
d19be7c

Commits on Jul 4, 2022

Update English StreamisAppConnDesignDocument
v_xiangbiaowu
committed
f12b28a
add linkis1.1.2 support description
v_xiangbiaowu
committed
3751197
Merge pull request #38 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996
authored
3aea2c5
Enable the streamis to support different version of Linkis
Davidhua1996
committed
81150dc
Merge branch 'dev-0.2.0' into dev-0.2.0-version-compatible
Davidhua1996
committed
72218d3
Change the format of linkis.properties
Davidhua1996
committed
0efc59b
Merge pull request #40 from WeDataSphere/dev-0.2.0-version-compatible
wushengyeyouya
authored
14a5aeb

Commits on Jul 5, 2022

init upgrade document and update English pictures
v_xiangbiaowu
committed
ea8d3d2
update architecture picture
v_xiangbiaowu
committed
106433b
Merge pull request #41 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996
authored
f70e82d
Merge pull request #42 from WeBankFinTech/dev-0.2.0
Davidhua1996
authored
179fdf6

Commits on Oct 17, 2022

Support the method to get engine conn resource information.
Davidhua1996
committed
36b9ec7
Init the structure of log module.
Davidhua1996
committed
9c75477

Commits on Oct 19, 2022

Commits on Oct 20, 2022

Commits on Oct 21, 2022

Commits on Oct 23, 2022

Commits on Oct 25, 2022

Commits on Oct 26, 2022

Commits on Oct 29, 2022

Commits on Oct 31, 2022

Commits on Nov 7, 2022

adjust the relation path in pom.xml.
Davidhua1996
committed
4cda151
Fix the problem in pom.xml of stream job log modules.
Davidhua1996
committed
6a07287

Commits on Nov 15, 2022

Commits on Dec 15, 2022

Merge pull request #54 from WeDataSphere/dev-0.2.3-log-collector
jefftlin
authored
fe00dff

Commits on Dec 20, 2022

Upgrade the version of pom to 0.2.3 (#55)

jefftlin
and
jefftlin
authored
95e6643
Use the "flink.yarn.ship-directories" instead of "flink.app.user.class.path" fixed #56
Davidhua1996
committed
0e98bab
Merge pull request #57 from WeDataSphere/dev-0.2.3-bugfix
jefftlin
authored
00c93e8
Upgrade the version of pom to 0.2.4 (#58)

jefftlin
and
jefftlin
authored
ced5eff
Optimization of log collector module (#60)
Davidhua1996
authored
1d33075

Commits on Dec 22, 2022

Support to deploy the version of job when the related task not completed.
Davidhua1996
committed
5ac9a6f

Commits on Dec 25, 2022

Inspections of stream job; Support to define job configuration in meta.json file.
Davidhua1996
committed
b6a1d31
Fix some problems.
Davidhua1996
committed
a070d23

Commits on Dec 29, 2022

Commits on Feb 8, 2023

Get latestJobVersion form StreamJobVersion
jefftlin
committed
f4d3846

Commits on Feb 14, 2023

Fix bug of getting inspectName & getLatestJobVersion
jefftlin
committed
09a3a5e

Commits on Feb 15, 2023

Sort the job version details
jefftlin
committed
b5659fc

Commits on Feb 19, 2023

Adjust the order to inspect the savepoint path defined first
Davidhua1996
committed
6ea958a