Coding of multichannel signals with irregular sampling rates and data gaps
The relentless advances in mobile communications and the Internet have contributed to a rapid increase in the amount of digital data created and replicated worldwide, which is estimated to double every three years. In this context, data compression algorithms, which allow for the reduction of the nu...
Saved in:
| Main Author: | |
|---|---|
| Format: | masterThesis |
| Language: | English |
| Published: |
2021
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/20.500.12008/36555 |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1868890022902497280 |
|---|---|
| author | Cerveñansky Fierro, Pablo |
| author_browse | Cerveñansky Fierro, Pablo |
| author_facet | Cerveñansky Fierro, Pablo |
| author_role | author |
| collection | COLIBRI |
| dc.contributor.none.fl_str_mv | Cerveñansky Fierro Pablo, Universidad de la República (Uruguay). Facultad de Ingeniería |
| dc.creator.none.fl_str_mv | Cerveñansky Fierro, Pablo |
| dc.date.none.fl_str_mv | 2021 2023-03-28T22:53:00Z 2023-03-28T22:53:00Z |
| dc.format.none.fl_str_mv | 92 p. application/pdf |
| dc.identifier.none.fl_str_mv | Cerveñansky Fierro, P. Coding of multichannel signals with irregular sampling rates and data gaps [en línea]. Tesis de maestría. Montevideo : Udelar. FI. INCO : PEDECIBA. Área Informática, 2021. 1688-2792 https://hdl.handle.net/20.500.12008/36555 |
| dc.language.none.fl_str_mv | en_US eng |
| dc.publisher.none.fl_str_mv | Udelar.FI |
| dc.rights.none.fl_str_mv | info:eu-repo/semantics/openAccess Licencia Creative Commons Atribución - No Comercial - Sin Derivadas (CC - By-NC-ND 4.0) |
| dc.source.none.fl_str_mv | reponame:COLIBRI instname:Universidad de la República instacron:Universidad de la República |
| dc.subject.none.fl_str_mv | Multichannel signal compression Near-lossless compression Irregular sampling rate Data gaps |
| dc.title.none.fl_str_mv | Coding of multichannel signals with irregular sampling rates and data gaps |
| dc.type.none.fl_str_mv | Tesis de maestría info:eu-repo/semantics/masterThesis info:eu-repo/semantics/acceptedVersion |
| description | The relentless advances in mobile communications and the Internet have contributed to a rapid increase in the amount of digital data created and replicated worldwide, which is estimated to double every three years. In this context, data compression algorithms, which allow for the reduction of the number of bits needed to represent digital data, have become increasingly relevant. In this work, we focus on the compression of multichannel signals with irregular sampling rates and with data gaps. We consider state-of-the-art algorithms, which were designed to compress gapless signals with regular sampling, adapt them to operate with signals with irregular sampling rates and data gaps, and then evaluate their performance experimentally, through the compression of signals obtained from real-world datasets. Both the original and our adapted algorithms work in a near-lossless fashion, guaranteeing a bounded per-sample absolute error between the decompressed and the original signals. This includes the important lossless compression case, which corresponds to an error bound of zero. The algorithms compress signals by exploiting correlation between signal samples taken at close times (temporal correlation), and, in some cases, between samples from different channels (spatial correlation). For most algorithms we design and implement two variants: a masking (M ) variant, which first encodes the position of all the gaps, and then proceeds to encode the data values separately, and a non-masking (NM ) variant, which encodes the gaps and the data values together. For each algorithm, we compare the compression performance of both variants: our experimental results suggest that variant M is more robust and performs better in general. Every implemented algorithm variant depends on a window size parameter, which defines the size of the windows into which the data are partitioned for encoding. We analyze the sensitivity of variant M of each algorithm to this size parameter: for each dataset, we compress each data file, and compare the results obtained when using a window size optimized for said specific file, against the results obtained when using a window size optimized for the whole dataset. Our experimental results indicate that the difference in compression performance is generally rather small. The last part of our experimental analysis consists of comparing the compression performance of our adapted algorithms, with each other, and with the general-purpose lossless compression algorithm gzip. Following previous experimental results, we only consider variant M of each algorithm, and we always use the optimal window size for the whole dataset. Our experimental results reveal that none of the algorithm variants obtains the best compression performance in every scenario, which means that the optimal selection of a variant depends on the characteristics of the data to be compressed, and the error threshold that is allowed. In some cases, even a general-purpose compression algorithm such as gzip outperforms the specific algorithm variants. Nevertheless, we extract some general conclusions from our analysis: for large error thresholds, variant M of algorithm APCA achieves the best compression results, while variant M of algorithm PCA (and, in some cases of lossless compression, algorithm gzip) are preferred for lower threshold scenarios. |
| eu_rights_str_mv | openAccess |
| format | masterThesis |
| id | anni_447883ffe88e56e3cca6a2eaca5e2f2d |
| identifier_str_mv | Cerveñansky Fierro, P. Coding of multichannel signals with irregular sampling rates and data gaps [en línea]. Tesis de maestría. Montevideo : Udelar. FI. INCO : PEDECIBA. Área Informática, 2021. 1688-2792 |
| instacron_str | Universidad de la República |
| institution | Universidad de la República |
| instname_str | Universidad de la República |
| language | eng |
| language_invalid_str_mv | en_US |
| network_acronym_str | anni |
| network_name_str | oai-lr-anni |
| oai_identifier_str | oai:colibri.udelar.edu.uy:20.500.12008/36555 |
| publishDate | 2021 |
| publishDateSort | 2021 |
| publisher.none.fl_str_mv | Udelar.FI |
| reponame_str | COLIBRI |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | Licencia Creative Commons Atribución - No Comercial - Sin Derivadas (CC - By-NC-ND 4.0) |
| spelling | Coding of multichannel signals with irregular sampling rates and data gapsCerveñansky Fierro, PabloMultichannel signal compressionNear-lossless compressionIrregular sampling rateData gapsThe relentless advances in mobile communications and the Internet have contributed to a rapid increase in the amount of digital data created and replicated worldwide, which is estimated to double every three years. In this context, data compression algorithms, which allow for the reduction of the number of bits needed to represent digital data, have become increasingly relevant. In this work, we focus on the compression of multichannel signals with irregular sampling rates and with data gaps. We consider state-of-the-art algorithms, which were designed to compress gapless signals with regular sampling, adapt them to operate with signals with irregular sampling rates and data gaps, and then evaluate their performance experimentally, through the compression of signals obtained from real-world datasets. Both the original and our adapted algorithms work in a near-lossless fashion, guaranteeing a bounded per-sample absolute error between the decompressed and the original signals. This includes the important lossless compression case, which corresponds to an error bound of zero. The algorithms compress signals by exploiting correlation between signal samples taken at close times (temporal correlation), and, in some cases, between samples from different channels (spatial correlation). For most algorithms we design and implement two variants: a masking (M ) variant, which first encodes the position of all the gaps, and then proceeds to encode the data values separately, and a non-masking (NM ) variant, which encodes the gaps and the data values together. For each algorithm, we compare the compression performance of both variants: our experimental results suggest that variant M is more robust and performs better in general. Every implemented algorithm variant depends on a window size parameter, which defines the size of the windows into which the data are partitioned for encoding. We analyze the sensitivity of variant M of each algorithm to this size parameter: for each dataset, we compress each data file, and compare the results obtained when using a window size optimized for said specific file, against the results obtained when using a window size optimized for the whole dataset. Our experimental results indicate that the difference in compression performance is generally rather small. The last part of our experimental analysis consists of comparing the compression performance of our adapted algorithms, with each other, and with the general-purpose lossless compression algorithm gzip. Following previous experimental results, we only consider variant M of each algorithm, and we always use the optimal window size for the whole dataset. Our experimental results reveal that none of the algorithm variants obtains the best compression performance in every scenario, which means that the optimal selection of a variant depends on the characteristics of the data to be compressed, and the error threshold that is allowed. In some cases, even a general-purpose compression algorithm such as gzip outperforms the specific algorithm variants. Nevertheless, we extract some general conclusions from our analysis: for large error thresholds, variant M of algorithm APCA achieves the best compression results, while variant M of algorithm PCA (and, in some cases of lossless compression, algorithm gzip) are preferred for lower threshold scenarios.Udelar.FICerveñansky Fierro Pablo, Universidad de la República (Uruguay). Facultad de Ingeniería2023-03-28T22:53:00Z2023-03-28T22:53:00Z2021Tesis de maestríainfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/acceptedVersion92 p.application/pdfCerveñansky Fierro, P. Coding of multichannel signals with irregular sampling rates and data gaps [en línea]. Tesis de maestría. Montevideo : Udelar. FI. INCO : PEDECIBA. Área Informática, 2021.1688-2792https://hdl.handle.net/20.500.12008/36555reponame:COLIBRIinstname:Universidad de la Repúblicainstacron:Universidad de la Repúblicaen_USengLas obras depositadas en el Repositorio se rigen por la Ordenanza de los Derechos de la Propiedad Intelectual de la Universidad de la República.(Res. Nº 91 de C.D.C. de 8/III/1994 – D.O. 7/IV/1994) y por la Ordenanza del Repositorio Abierto de la Universidad de la República (Res. Nº 16 de C.D.C. de 07/10/2014)info:eu-repo/semantics/openAccessLicencia Creative Commons Atribución - No Comercial - Sin Derivadas (CC - By-NC-ND 4.0)oai:colibri.udelar.edu.uy:20.500.12008/365552026-04-14T10:27:57Z |
| spellingShingle | Coding of multichannel signals with irregular sampling rates and data gaps Cerveñansky Fierro, Pablo Multichannel signal compression Near-lossless compression Irregular sampling rate Data gaps |
| status_str | acceptedVersion |
| title | Coding of multichannel signals with irregular sampling rates and data gaps |
| title_full | Coding of multichannel signals with irregular sampling rates and data gaps |
| title_fullStr | Coding of multichannel signals with irregular sampling rates and data gaps |
| title_full_unstemmed | Coding of multichannel signals with irregular sampling rates and data gaps |
| title_short | Coding of multichannel signals with irregular sampling rates and data gaps |
| title_sort | Coding of multichannel signals with irregular sampling rates and data gaps |
| topic | Multichannel signal compression Near-lossless compression Irregular sampling rate Data gaps |
| url | https://hdl.handle.net/20.500.12008/36555 |