PyProcess

A Python library for setting up projects using tabular data. It can create project folders, standardize delimiters, and convert files to CSV from either individual files or a directory.

Documentation

To install, navigate to the directory holding your Python libraries, then copy the "pyprocess" folder into it. The pyrocess folder should contain the pyprocess.py and __init__.py files.

Example path: C:\Users\ \miniconda3\envs\ \Lib\site-packages\pyprocess

Class - Setup

Functions

setup.Project_Folders: Sets up project folders. Creates the main project folder, as well as Data, Methods, and Results folders within it.

Parameters

proj_dir: Path to the project directory. Can be an existing folder or one yet to be created.

Class - Clean

Functions

clean.Clean_Text: Cleans up text in files, with parameters for further cleaning up files when standarizing delimiters in tabular data. Saves the cleaned files to a folder named Cleaned_Files within the input directory.

Parameters

data_in: File, or directory of files, to be cleaned up. file/directory path

replacements: Dictionary of elements to be replaced. to-be-replaced:replacement, Example: replacements={"\t":","}

dir: Sets whether to process a single file or a directory of files. True/False

delete_empty: Removes any empty columns that get created when the delimiter is standardized (file specific). Has no effect if no empty columns are created. True/False

concat_newline: Sets whether to merge new line delimiters with the last element of each line so as to remove trailing commas. True/False

Class - Conversion

Functions

convert.CSV: Converts common tabular data files such as TXT and TSV files to CSV. Saves the converted files to a folder named CSV_Converted within the input directory.

Parameters

data_in: File, or directory of files, to be converted. file/directory path

sep: Delimiter used in the input file. Example: sep=","

dir: Sets whether to process a single file or a directory of files. True/False