FAST Aiming at the problems of cumbersome steps and slow download speed of GNSS data

Related tags

Deep LearningFAST
Overview

FAST (Fusion Abundant multi-Source data download Terminal)

介绍

FAST 针对目前GNSS数据下载步骤繁琐、下载速度慢等问题,开发了一套较为完备的融合多源数据下载终端软件——FAST。
软件目前包含GNSS科研学习过程中绝大部分所需的数据源,采用并行下载的方式极大的提升了下载的效率。

Git地址

软件特点

  • 多平台:同时支持windows与linux系统;
  • 资源丰富:基本囊括了GNSS科研学习中所需的数据源,目前支持15个大类、62个小类,具体支持数据见数据支持
  • 快速:软件采用并行下载方式,在命令行参数运行模式可自行指定下载线程数,经测试下载100天的brdc+igs+clk文件只需要48.93s!
  • 易拓展:如需支持更多数据源,可在FTP_Source.py、GNSS_TYPE.py中指定所需的数据与数据源;
  • 简单易行:程序有引导下载模式与命令行带参数运行模式两种方式下载,直接运行程序便可进入引导下载模式,命令行带参数运行FAST -h可查看带参数运行模式介绍;
  • 灵活:在带参数运行模式下,用户可灵活指定下载类型、下载位置、下载时间、是否解压、线程数等,可根据自我需求编写bat、shell、python等脚本运行;
  • 轻便:windows程序包仅有18.9 MB,Liunx程序包仅有6.63 MB.

安装教程

  • Windows系统下仅需解压程序包即可直接运行,CMD运行FAST.exe -h可查看带参数运行模式介绍;
  • Linux系统下需安装先导软件wget\lftp\ncompress\python3,以Ubuntu系统为例,于终端中输入以下代码:
apt-get install wget
apt-get install lftp
apt-get install ncompress
apt-get install python3

安装后如windows系统下相同可直接运行程序,或将程序配置至环境变量中。

使用说明

引导下载模式Windows系统双击运行FAST.exe便可进入引导下载,若为Linux系统终端输入FAST运行即可:

  1. 以下载武汉大学多系统精密星历为例,在一级选择目录中选择SP3,即为输入2后回车;
    一级目录

  2. 选择MGEX_WUH_sp3即为输入6并回车,其中MGEX代表多系统,WUH代表武汉大学IGS数据处理中心,SP3代表精密星历; 二级目录

  3. 根据引导输入时间,回车完成输入; 输入时间

  4. 下载完成,根据提示直接回车完成解压或者输入任意字符回车不解压; 下载完成 解压完成

  5. 根据提示输入y再次进入引导或退出;
    在此引导

命令行带参数运行模式Windows系统CMD或power shell运行FAST.exe -h可查看命令行运行帮助,若为Linux系统终端输入FAST -h查看帮助:

  FAST : Fusion Abundant multi-Source data download Terminal
  ©Copyright 2022.01 @ Chang Chuntao
  PLEASE DO NOT SPREAD WITHOUT PERMISSION OF THE AUTHOR !

  Usage: FAST 

  Where the following are some of the options avaiable:

  -v,  --version                   display the version of GDD and exit
  -h,  --help                      print this help
  -t,  --type                      GNSS type, if you need to download multiple data,
                                   Please separate characters with " , "
                                   Example : GPS_brdc,GPS_IGS_sp3,GPS_IGR_clk
  -l,  --loc                       which folder is the download in
  -y,  --year                      where year are the data to be download
  -d,  --day                       where day are the data to be download
  -o,  --day1                      where first day are the data to be download
  -e,  --day2                      where last day are the data to be download
  -m,  --month                     where month are the data to be download
  -u,  --uncomprss Y/N             Y - unzip file (default)
                                   N - do not unzip files
  -f,  --file                      site file directory,The site names in the file are separated by spaces.
                                   Example : bjfs irkj urum
  -p   --process                   number of threads (default 12)

  Example: FAST -t MGEX_IGS_atx
           FAST -t GPS_brdc,GPS_IGS_sp3,GPS_IGR_clk -y 2022 -d 22 -p 30
           FAST -t MGEX_WUH_sp3 -y 2022 -d 22 -u N -l D:\code\CDD\Example
           FAST -t MGEX_IGS_rnx -y 2022 -d 22 -f D:\code\cdd\mgex.txt
           FAST -t IVS_week_snx -y 2022 -m 1

数据支持

  1. BRDC : GPS_brdc / MGEX_brdm

  2. SP3 : GPS_IGS_sp3 / GPS_IGR_sp3 / GPS_IGU_sp3 / GPS_GFZ_sp3 / GPS_GRG_sp3
    MGEX_WUH_sp3 / MGEX_WUHU_sp3 / MGEX_GFZ_sp3 / MGEX_COD_sp3
    MGEX_SHA_sp3 / MGEX_GRG_sp3 / GLO_IGL_sp3

  3. RINEX :GPS_IGS_rnx / MGEX_IGS_rnx / GPS_USA_cors / GPS_HK_cors / GPS_EU_cors
    GPS_AU_cors

  4. CLK : GPS_IGS_clk / GPS_IGR_clk / GPS_IGU_clk / GPS_GFZ_clk / GPS_GRG_clk GPS_IGS_clk_30s MGEX_WUH_clk / MGEX_COD_clk / MGEX_GFZ_clk / MGEX_GRG_clk / WUH_PRIDE_clk

  5. ERP : IGS_erp / WUH_erp / COD_erp / GFZ_erp

  6. BIA : MGEX_WHU_bia / GPS_COD_bia / MGEX_COD_bia / MGEX_GFZ_bia

  7. ION : IGS_ion / WUH_ion / COD_ion

  8. SINEX : IGS_day_snx / IGS_week_snx / IVS_week_snx / ILS_week_snx / IDS_week_snx

  9. CNES_AR : CNES_post / CNES_realtime

  10. ATX : MGEX_IGS_atx

  11. DCB : GPS_COD_dcb / MGEX_CAS_dcb / MGEX_WHU_OSB / P1C1 / P1P2 / P2C2

  12. Time_Series : IGS14_TS_ENU / IGS14_TS_XYZ / Series_TS_Plot

  13. Velocity_Fields : IGS14_Venu / IGS08_Venu / PLATE_Venu

  14. SLR : HY_SLR / GRACE_SLR / BEIDOU_SLR

  15. OBX : GPS_COD_obx / GPS_GRG_obx / MGEX_WUH_obx / MGEX_COD_obx / MGEX_GFZ_obx

  16. TRO : IGS_zpd / COD_tro / JPL_tro / GRID_1x1_VMF3 / GRID_2.5x2_VMF1 / GRID_5x5_VMF3

参与贡献

  1. 常春涛@中国测绘科学研究院
    程序思路、主程序编写、文档编写、程序测试

  2. 蒋科材博士后@武汉大学
    程序思路、并行计算处理思路

  3. 慕任海博士@武汉大学
    程序思路、程序编写、程序测试

  4. 李博博士@辽宁工程技术大学&中国测绘科学研究院
    程序测试、文档编写、节点汇总

  5. 李勇熹@兰州交通大学&中国测绘科学研究院
    程序测试、节点汇总

  6. 曹多明@山东科技大学&中国测绘科学研究院
    程序测试、节点汇总

Owner
ChangChuntao
QQ 1252443496 WECHAT amst-jazz
ChangChuntao
My implementation of Fully Convolutional Neural Networks in Keras

Keras-FCN This repository contains my implementation of Fully Convolutional Networks in Keras (Tensorflow backend). Currently, semantic segmentation c

The Duy Nguyen 15 Jan 13, 2020
Label Mask for Multi-label Classification

LM-MLC 一种基于完型填空的多标签分类算法 1 前言 本文主要介绍本人在全球人工智能技术创新大赛【赛道一】设计的一种基于完型填空(模板)的多标签分类算法:LM-MLC,该算法拟合能力很强能感知标签关联性,在多个数据集上测试表明该算法与主流算法无显著性差异,在该比赛数据集上的dev效果很好,但是由

52 Nov 20, 2022
MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Tasks

MetaBalance: Improving Multi-Task Recommendations via Adapting Gradient Magnitudes of Auxiliary Tasks Introduction This repo contains the pytorch impl

Meta Research 38 Oct 10, 2022
Implementing DeepMind's Fast Reinforcement Learning paper

Fast Reinforcement Learning This is a repo where I implement the algorithms in the paper, Fast reinforcement learning with generalized policy updates.

Marcus Chiam 6 Nov 28, 2022
A JAX-based research framework for writing differentiable numerical simulators with arbitrary discretizations

jaxdf - JAX-based Discretization Framework Overview | Example | Installation | Documentation ⚠️ This library is still in development. Breaking changes

UCL Biomedical Ultrasound Group 65 Dec 23, 2022
Automatic caption evaluation metric based on typicality analysis.

SeMantic and linguistic UndeRstanding Fusion (SMURF) Automatic caption evaluation metric described in the paper "SMURF: SeMantic and linguistic UndeRs

Joshua Feinglass 6 Jan 09, 2022
Binary Passage Retriever (BPR) - an efficient passage retriever for open-domain question answering

BPR Binary Passage Retriever (BPR) is an efficient neural retrieval model for open-domain question answering. BPR integrates a learning-to-hash techni

Studio Ousia 147 Dec 07, 2022
PSML: A Multi-scale Time-series Dataset for Machine Learning in Decarbonized Energy Grids

PSML: A Multi-scale Time-series Dataset for Machine Learning in Decarbonized Energy Grids The electric grid is a key enabling infrastructure for the a

Texas A&M Engineering Research 19 Jan 07, 2023
Genetic Algorithm, Particle Swarm Optimization, Simulated Annealing, Ant Colony Optimization Algorithm,Immune Algorithm, Artificial Fish Swarm Algorithm, Differential Evolution and TSP(Traveling salesman)

scikit-opt Swarm Intelligence in Python (Genetic Algorithm, Particle Swarm Optimization, Simulated Annealing, Ant Colony Algorithm, Immune Algorithm,A

郭飞 3.7k Jan 03, 2023
Official implementation of YOGO for Point-Cloud Processing

You Only Group Once: Efficient Point-Cloud Processing with Token Representation and Relation Inference Module By Chenfeng Xu, Bohan Zhai, Bichen Wu, T

Chenfeng Xu 67 Dec 20, 2022
The official implementation of Autoregressive Image Generation using Residual Quantization (CVPR '22)

Autoregressive Image Generation using Residual Quantization (CVPR 2022) The official implementation of "Autoregressive Image Generation using Residual

Kakao Brain 529 Dec 30, 2022
Mmrotate - OpenMMLab Rotated Object Detection Benchmark

OpenMMLab website HOT OpenMMLab platform TRY IT OUT 📘 Documentation | 🛠️ Insta

OpenMMLab 1.2k Jan 04, 2023
Code repo for EMNLP21 paper "Zero-Shot Information Extraction as a Unified Text-to-Triple Translation"

Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Source code repo for paper Zero-Shot Information Extraction as a Unified Text

cgraywang 88 Dec 31, 2022
Dashboard for the COVID19 spread

COVID-19 Data Explorer App A streamlit Dashboard for the COVID-19 spread. The app is live at: [https://covid19.cwerner.ai]. New data is queried from G

Christian Werner 22 Sep 29, 2022
This reposityory contains the PyTorch implementation of our paper "Generative Dynamic Patch Attack".

Generative Dynamic Patch Attack This reposityory contains the PyTorch implementation of our paper "Generative Dynamic Patch Attack". Requirements PyTo

Xiang Li 8 Nov 17, 2022
Repository aimed at compiling code, papers, demos etc.. related to my PhD on 3D vision and machine learning for fruit detection and shape estimation at the university of Lincoln

PhD_3DPerception Repository aimed at compiling code, papers, demos etc.. related to my PhD on 3D vision and machine learning for fruit detection and s

lelouedec 2 Oct 06, 2022
Plug-n-Play Reinforcement Learning in Python with OpenAI Gym and JAX

coax is built on top of JAX, but it doesn't have an explicit dependence on the jax python package. The reason is that your version of jaxlib will depend on your CUDA version.

128 Dec 27, 2022
Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods

Cold Brew: Distilling Graph Node Representations with Incomplete or Missing Neighborhoods Introduction Graph Neural Networks (GNNs) have demonstrated

37 Dec 15, 2022
LRBoost is a scikit-learn compatible approach to performing linear residual based stacking/boosting.

LRBoost is a sckit-learn compatible package for linear residual boosting. LRBoost combines a linear estimator and a non-linear estimator to leverage t

Andrew Patton 5 Nov 23, 2022
NPBG++: Accelerating Neural Point-Based Graphics

[CVPR 2022] NPBG++: Accelerating Neural Point-Based Graphics Project Page | Paper This repository contains the official Python implementation of the p

Ruslan Rakhimov 57 Dec 03, 2022