devbox
喵喵爱编程
这个屌丝很懒，什么也没留下！
关注作者
热门标签
热门文章
当前位置:   article > 正文

DataWorks 安装手册

作者：喵喵爱编程 | 2024-08-22 00:56:42

赞

踩

dataworks安装

2019独角兽企业重金招聘Python工程师标准>>> hot3.png

DataWorks 安装手册

tags： gsac

[TOC]

1. 环境介绍

系统 : CentOS release 6.8 (Final) _x64 集成工具 : xampp 1.8.1 (包含 mysql 5.5.27， proFtp) 软件 : DataWorks-SW jdk : java version "1.7.0_111"

2. 安装软件

在 DataWorks-SW 压缩包中，存在安装说明，以下的安装步骤就是根据安装说明来的，如果需要了解更详细的安装说明，请阅读 README_Dataworks_Installation_Operation 文件。

2.1 创建数据库

按照文件 Dataworks-SW/database/README_create_MySQL_database 的说明来创建数据库。 使用 /opt/lampp/bin/mysql -u root -p 命令登录数据库。

  1. mysql> source /home/data/apps/Dataworks-SW/database/Dataworks_demo.sql; # 导入数据文件，会自动创建数据库
  2. mysql> show tables;                 # 查看数据库的表情况
  3. +-----------------------------------+
  4. | Tables_in_Dataworks_GSAC_database |
  5. +-----------------------------------+
  6. | access                            |
  7. | agency                            |
  8. | antenna                           |
  9. | country                           |
  10. | datafile                          |
  11. | datafile_type                     |
  12. | ellipsoid                         |
  13. | equip_config                      |
  14. | locale                            |
  15. | metpack                           |
  16. | monument_style                    |
  17. | network                           |
  18. | radome                            |
  19. | receiver_firmware                 |
  20. | station                           |
  21. | station_status                    |
  22. | station_style                     |
  23. +-----------------------------------+
  24. 17 rows in set (0.00 sec)

不能有任何错误，否则需要重新创建。

2.2 创建和安装 GSAC, 并且测试

GSAC 的安装分为两个部分， Part 1 的说明在 Dataworks-SW/dataworks-gsac/src/org/gsac/README 中，Part 2 的说明在 Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/README， 按照两部分的说明来安装。

2.2.1 Part 1
  1. 安装 ant 构建工具来构建java项目，命令 yum install ant 执行安装。 注意： 因为我用的jdk 版本为 1.7，所以可以直接构建，如果使用的jdk版本为1.6，一定要参照说明。
  2. 进入 Dataworks-SW/dataworks-gsac/src/org/gsac 所在目录
  3. 执行 ant 命令.
  4. 编辑地图配置脚本repositorymap.js,在dataworks-gsac/src/org/gsac/gsl/htdocs/repositorymap.js 打开repositorymap.js 文件，按照提示设置
  1. /*  set zoom level for map of GSAC sites; zoom level 3 is about 10,000 km wide; 4 ~ 4000 km;  5 ~ 2000 km;  6 ~ km.设置地图显示的距离大小是多少公里，分为 3， 4， 5， 6 四个等级 */
  2. var defaultZoomLevel = 5;
  3. /*  set center of GSAC site map, with (LONGITUDE, LATITUDE ) ; longitude east (west is negative), latitude north 这是中心坐标点，这里我用的房山的坐标点*/
  4. var defaultLocation = new OpenLayers.LonLat(39.00, 116.00);
  1. 再在dataworks-gsac/src/org/gsac/gsl/目录下执行ant命令
2.2.2 Part 2

通过命令进入 cd dataworks-gsac/src/org/dataworks/gsac/目录，按照README的说明完成第二部分。

  1. 编辑resources/gsac.properties文件，参照说明，如果没有需要，可以不用修改
  2. 编辑dbresources/gsacdb_test.properties文件，设置数据库相关信息
  1. ## This is the database name and account information for GSAC
  2. gsac.db.username=root
  3. gsac.db.password=chgsac
  4. gsac.db.jdbcurl=jdbc:mysql://127.0.0.1:3306/Dataworks_GSAC_database?useUnicode=yes&characterEncoding=UTF-8
  1. 检查org/dataworks/gsac目录下的 build.xml 文件
  1. <target name="localinit">
  2.     <!-- base name for build products， 此处的 `dataworksgsac` 要保证相同 -->
  3.     <property name="basename" value="dataworksgsac"/>
  1. 在 org/dataworks/gsac 目录下执行 ant 命令
  1. [root@localhost gsac]# ant
  2. Buildfile: build.xml
  3. test_build:
  4. localinit:
  5. init:
  6. clean:
  7. build:
  8.      [echo] Creating test build
  9.      [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/resources
  10.      [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/resources
  11. localinit:
  12. init:
  13. clean:
  14. compile:
  15.     [javac] Compiling 7 source files
  16.     [javac] \u6ce8: /home/data/apps/Dataworks-SW/dataworks-gsac/src/org/dataworks/gsac/DataworksSiteManager.java\u4f7f\u7528\u4e86\u672a\u7ecf\u68c0\u67e5\u6216\u4e0d\u5b89\u5168\u7684\u64cd\u4f5c\u3002
  17.     [javac] \u6ce8: \u6709\u5173\u8be6\u7ec6\u4fe1\u606f, \u8bf7\u4f7f\u7528 -Xlint:unchecked \u91cd\u65b0\u7f16\u8bd1\u3002
  18. gsacjar:
  19.     [echo] Making jar /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.jar
  20.     [jar] Building jar: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.jar
  21. release:
  22.     [echo] Making /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.zip
  23.    [delete] Deleting directory /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  24.     [mkdir] Created dir: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  25.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  26.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  27.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  28.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  29.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  30.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  31.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  32.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  33.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  34.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  35.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  36.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  37.     [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0
  38.     [zip] Building zip: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0.zip
  39. localinit:
  40. init:
  41. war:
  42.      [copy] Copying 1 file to /home/data/apps/Dataworks-SW/dataworks-gsac/dist
  43.    [delete] Deleting: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsactest1.0/javax.servlet-api-3.1.0.jar
  44.       [war] Building war: /home/data/apps/Dataworks-SW/dataworks-gsac/dist/dataworksgsac.war
  45.      [echo] ********************************
  46.      [echo] To run the server run:
  47.      [echo] ant runserver
  48.      [echo] ********************************
  49. BUILD SUCCESSFUL
  50. Total time: 4 seconds
  1. 测试 GSAC 执行命令 ant runserver ， 结果报错
  1.      [java] Error:java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.security.AccessControlException: access denied ("javax.management.MBeanTrustPermission" "register")
  2.      [java] java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: java.security.AccessControlException: access denied ("javax.management.MBeanTrustPermission" "register")

解决错误：设置Javax Security java.policy file 编辑/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.111.x86_64/jre/lib/security/java.policy 文件

  1. grant {
  2.     //   many other lines
  3.  
  4.     // JMX Java Management eXtensions                               # 添加的注释
  5.     permission javax.management.MBeanTrustPermission "register";    # 添加的内容
  6. };

再来执行 ant runserver，启动成功

  1. [root@localhost gsac]# ant runserver
  2. Buildfile: build.xml
  3.  
  4. localinit:
  5.  
  6. init:
  7.  
  8. runserver:
  9.      [java] JVM args ignored when same JVM is used.
  10.      [java] 2016-09-07 10:55:18.814:INFO::main: Logging initialized @467ms
  11.      [java] GSAC: GsacServlet:initServlet: making repository:org.dataworks.gsac.DataworksRepository
  12.      [java] GSAC: Starting this GSAC server, at 2016-09-07T02:55:19 +0000
  13.      [java] Running stand-alone GSAC server at: http://localhost:8080/dataworksgsac
  14.      [java] 2016-09-07 10:55:19.758:INFO:oejs.Server:main: jetty-9.2.6.v20141205
  15.      [java] 2016-09-07 10:55:19.831:INFO:oejsh.ContextHandler:main: Started o.e.j.s.ServletContextHandler@29ab993{/,null,AVAILABLE}
  16.      [java] 2016-09-07 10:55:19.904:INFO:oejs.ServerConnector:main: Started ServerConnector@4a6e1c9a{HTTP/1.1}{0.0.0.0:8080}
  17.      [java] 2016-09-07 10:55:19.905:INFO:oejs.Server:main: Started @1562ms

登录网站 http://localhost:8080/dataworksgsac 访问，能够打开网页看到 GSAC 内容。 至此 GSAC 安装完成。

3. 导入数据

导入数据使用的是Dataworks-SW/mirror目录下的 mirrorStations.py 和 mirrorData.py 这两个 python 脚本， mirrorStations.py 的作用是导入站点数据，mirrorData.py 的作用是根据导入的站点来导入真实的数据信息到数据库。 注意： 两个脚本在执行的时候必须先导入站点数据，才能再执行导入数据的脚本。不能颠倒！！！

3.1 导入站点数据

在执行脚本之前需要安装 python-mysqldb ，在 CentOS 系统中使用命令 yum install MySQL-python.x86_64来安装 命令解析： ./mirrorStations.py "STK2;MIZU;KSMV;TSK2" dbHostname dbAccount dbPasswd dbName ` 执行脚本命令 要导入的站点 ; 隔开 数据库ip地址 用户名 密码 数据库名

  1. # 导入国外站点
  2. [root@localhost mirror]# ./mirrorStations.py "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" localhost root root dataworks_gsac_database 
  3. Traceback (most recent call last):
  4.   File "./mirrorStations.py", line 996, in <module>
  5.     gsacdb = MySQLdb.connect(dbhost, dbacct, dbacctpw, dbname)
  6.   File "/usr/lib64/python2.6/site-packages/MySQLdb/__init__.py", line 81, in Connect
  7.     return Connection(*args, **kwargs)
  8.   File "/usr/lib64/python2.6/site-packages/MySQLdb/connections.py", line 187, in __init__
  9.     super(Connection, self).__init__(*args, **kwargs2)
  10. _mysql_exceptions.OperationalError: (2002, "Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2)")

报错：Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock 解决办法如下：

  1. # 导入国外站点
  2. [root@localhost mirror]# mkdir -p /var/lib/mysql
  3. [root@localhost mirror]# ln -s /opt/lampp/var/mysql/mysql.sock /var/lib/mysql/mysql.sock # 创建软连接
  4. [root@localhost mirror]# ./mirrorStations.py "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" 127.0.0.1 root root dataworks_gsac_database
  5.  
  6.     Connected to the database dataworks_gsac_database with account root, on 127.0.0.1
  7.     
  8.     First, get site and equipment metadata at those sites from the UNAVCO GSAC. The GSAC API Linux command is 
  9.     /usr/bin/curl -L  "http://www.unavco.org/data/web-services/gsacws/gsacapi/site/search?output=sitefull.csv&site.interval=interval.normal&site.code=DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" > dataworks_stations.csv
  10.   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
  11.                                  Dload  Upload   Total   Spent    Left  Speed
  12. 100 65180    0 65180    0     0   1432      0 --:--:--  0:00:45 --:--:--  7129
  1. # 导入国内站点,导入成功样例，可能耗时会有点久，需要等待
  2. [root@localhost mirror]# ./mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" localhost root root Dataworks_GSAC_database
  3.  
  4.     Connected to the database Dataworks_GSAC_database with account root, on localhost
  5.  
  6.     First, get site and equipment metadata at those sites from the UNAVCO GSAC. The GSAC API Linux command is 
  7.     /usr/bin/curl -L  "http://www.unavco.org/data/web-services/gsacws/gsacapi/site/search?output=sitefull.csv&site.interval=interval.normal&site.code=kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" > dataworks_stations.csv
  8.   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
  9.                                  Dload  Upload   Total   Spent    Left  Speed
  10. 100  9806    0  9806    0     0     55      0 --:--:--  0:02:56 --:--:--   897
  11.  
  12.   Metadata for station ID BJFS                  named Beijing Fangshan / China
  13.  
  14.   Metadata for station ID BJNM                  named BJNM antenna at NIM
  15.  
  16.   Metadata for station ID CHAN                  named CHANGCHUN
  17.  
  18.   Metadata for station ID GUAO                  named GUAO
  19.  
  20.   Metadata for station ID JFNG                  named JIUFENG
  21.  
  22.   Metadata for station ID KUNM                  named Kunming
  23.  
  24.   Metadata for station ID LHAZ                  named Lhasa / Tibet / China
  25.  
  26.   Metadata for station ID SHAO                  named Shanghai Obs/Sheshan Station
  27.  
  28.   Metadata for station ID TCMS                  named Hsinchu
  29.  
  30.   Metadata for station ID TWTF                  named Taoyuan
  31.  
  32.   Metadata for station ID URUM                  named Urumqi - People Republic of China
  33.  
  34.   Metadata for station ID WUHN                  named WUHAN

添加定时任务： 使用crontab -e命令添加定时任务，注意服务器重启以后会失效，需要重新添加。

  1. # 每天晚上 0 点 1 分，开始更新站点数据，并且不保存日志
  2. 1 0 * * * /home/gsac/apps/Dataworks-SW/mirror/mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" localhost root root Dataworks_GSAC_database > /dev/null 2>&1

3.2 导入数据信息

命令解析： ./mirrorData.py dbhost dbacct dbpw dbname 4daysback today "kunm;lhaz" 脚本 数据库ip 账号 密码 数据库名 4天前 今天 站点代号

  1. # 导入国内数据文件信息到数据库
  2. ./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms"
  3.  
  4. # 导入国外数据文件信息
  5. ./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG"

为数据导入添加定时任务：

  1. [root@localhost apps]# crontab -l
  2. # mei tian 24 dian kaishi genxin zhandian 
  3. 1 0 * * * /home/gsac/apps/Dataworks-SW/mirror/mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" localhost root root Dataworks_GSAC_database > /dev/null 2>&1  
  4.  
  5. # mei tian 3 dian kaishi dao ru shuju wenjian
  6. 1 3 * * * /home/gsac/apps/Dataworks-SW/mirror/mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" > /dev/null 2>&1

至此：站点导入和数据信息的导入完成，以后会每天定时执行导入工作。

4. 数据的下载和ftp的至此

在 linux 系统下，会使用 wget 命令来充 GNSS 获取数据，如： wget -c -x -P ~/data/file ftp://data-out.unavco.org/pub/rinex/obs/2000/061/ugeo0610.00d.Z 通过前面的操作后数据都写入进数据库了，如下所示，replace.this.org 让我们替换成自己本地的ftp ip

  1. mysql> select datafile_id ,url_path from datafile;
  2. +-------------+----------------------------------------------------------+
  3. | datafile_id | url_path                                                 |
  4. +-------------+----------------------------------------------------------+
  5. |        2049 | ftp://replace.this.org/rinex/nav/2016/249/bjnm2490.16g.Z |
  6. |        2050 | ftp://replace.this.org/rinex/nav/2016/249/bjnm2490.16n.Z |
  7. |        2051 | ftp://replace.this.org/rinex/obs/2016/249/bjnm2490.16d.Z |
  8. |        2052 | ftp://replace.this.org/rinex/nav/2016/249/chan2490.16n.Z |
  9. |        2053 | ftp://replace.this.org/rinex/obs/2016/249/chan2490.16d.Z |
  10. +-------------+----------------------------------------------------------+
  11. 29 rows in set (0.00 sec)

以 shell 脚本来完成上述操作

  1. #!/bin/bash
  2. ##############################
  3. # @file DataDownload.sh
  4. # @brief 用来下载 GNSS 数据的 shell 脚本
  5. # @author liukai
  6. # @version 1.0
  7. # @date 2016-09-08
  8. ##############################
  9.  
  10. ip="168.168.169.199"                            # 主机ip地址
  11. dbUser="root"                                   # 数据库用户名
  12. dbPasswd="root"                                 # 数据库密码
  13. dbName="Dataworks_GSAC_database"                # 数据库实例名
  14. dbUrlPath="replace.this.org"                    # datafile 表中 url_path 字段中要替换的连接名
  15. replaceUrlPath="data-out.unavco.org/pub"        # 被替换的连接名
  16. ftpUrlPath="${ip}/${replaceUrlPath}"            # 最后替换的本地ftp路径
  17.  
  18.  
  19. # 获取要下载数据的 ftp path
  20. getUrlPaths() {
  21.         # 查询数据库，将 url_path 放到变量 paths 中
  22.         command="select url_path from datafile;"
  23.         declare paths=`/opt/lampp/bin/mysql -u${dbUser} -p${dbPasswd} -D${dbName} -e "${command}" --skip-column-name`
  24.  
  25.         # 循环数组，拼接成 GNSS 的 ftp 下载地址，然后使用 wget 命令将文件下载到ftp目录
  26.         for url in $paths
  27.         do
  28.                 copyUrl="${url}"
  29.                 if [ ${url:6:16}  = ${dbUrlPath} ] ; then
  30.                         `wget -c -x -P /opt/lampp/htdocs/ ${copyUrl/${dbUrlPath}/${replaceUrlPath}}`
  31.                 fi
  32.         done
  33.  
  34.         # 最后，更新 url_path 为本地 ftp 路径
  35.         command2="update datafile set url_path=replace(url_path,\"${dbUrlPath}\",\"${ftpUrlPath}\");"
  36.         `/opt/lampp/bin/mysql -u${dbUser} -p${dbPasswd} -D${dbName} -e "${command2}"`
  37.  
  38. }
  39.  
  40. echo "--------------------开始下载文件------------------------------"
  41. getUrlPaths
  42. echo "--------------------文件下载完成------------------------------"

5. 脚本整合，添加任务调度

  1. # 这是国内站点的任务调度内容
  2. # mei tian 24 dian kaishi genxin zhandian 
  3. 1 22 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorStations.py "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms" 127.0.0.1 root root Dataworks_GSAC_database  >> /home/gsac/logs/station`date +\%Y\%m\%d`.log 2>&1
  4.  
  5. # mei tian 3 dian kaishi dao ru shuju wenjian
  6. 1 0 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "kunm;lhaz;guao;urum;chan;bjfs;bjnm;wuhn;jfng;shao;twtf;tcms"  >> /home/gsac/logs/data`date +\%Y\%m\%d`.log 2>&1
  7.  
  8. 1 3 * * * /home/gsac/apps/Dataworks-SW/mirror/DataDownload.sh  >> /home/gsac/logs/download`date +\%Y\%m\%d`.log 2>&1
  9.  
  10. # 这个国外站点的调度任务
  11. 1 21 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorStations.py "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" 127.0.0.1 root root Dataworks_GSAC_database >> /home/gsac/logs/station`date +\%Y\%m\%d`.log 2>&1
  12.  
  13. 1 1 * * * cd /home/gsac/apps/Dataworks-SW/mirror && ./mirrorData.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "DAEJ;SUWN;YUNS;YSSK;STK2;MIZU;KSMV;TSK2;MTKA;KGNI;USUD;SMST;AIRA;GMSD;CCJ2;MAGO;YAKT;TIXI;NRIL;IRKJ;NBADG;NOVM;NVSK;ARTU;ULAB;KRTV;PODG;SUMK;POL2;CHUM;BIKO;KAZA;TALA;TASH;KIT3;MANM;SYBC;CHLM;DNC4;LMJG;DNSG;JMSM;MSKT;BMCL;DNGD;CUSV;BAKO;BNOA;BTNG;PNGM;PIMO;PIAG" >> /home/gsac/logs/data`date +\%Y\%m\%d`.log 2>&1
  14.  
  15. 1 4 * * * /home/gsac/apps/Dataworks-SW/mirror/DataDownload.sh  >> /home/gsac/logs/download`date +\%Y\%m\%d`.log 2>&1

6. GSAC 镜像映射方案

采用 python 脚本来完成镜像的映射。 ./mirrorStations_199.py "bjnm;wuhn" 127.0.0.1 root root Dataworks_GSAC_database 命令将从199机器获取站点编号为kunm;lhaz 的两个站点的station信息。 ./mirrorData_199.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "bjnm;wuhn"命令会将上面更新站点信息的两个站点数据下载到本地。

./mirrorStations_200.py "DAEJ,NOVM" 127.0.0.1 root root Dataworks_GSAC_database ./mirrorData_200.py 127.0.0.1 root root Dataworks_GSAC_database 4daysback today "DAEJ,NOVM"

转载于:https://my.oschina.net/u/2002410/blog/780474

声明：本文内容由网友自发贡献，不代表【wpsshop博客】立场，版权归原作者所有，本站不承担相应法律责任。如您发现有侵权的内容，请联系我们。转载请注明出处：https://www.wpsshop.cn/w/喵喵爱编程/article/detail/1014039
推荐阅读
相关标签

Copyright © 2003-2013 www.wpsshop.cn 版权所有，并保留所有权利。

  

闽ICP备14008679号