Distributed stream and event processing pipeline in serverless architecture
| dc.contributor.advisor | Kyriazis, Dimosthenis | |
| dc.contributor.advisor | Κυριαζής, Δημοσθένης | |
| dc.contributor.author | Fotiadis, Orestis | |
| dc.contributor.author | Φωτιάδης, Ορέστης | |
| dc.date.accessioned | 2021-07-30T05:19:32Z | |
| dc.date.available | 2021-07-30T05:19:32Z | |
| dc.date.issued | 2021-06 | |
| dc.identifier.uri | https://dione.lib.unipi.gr/xmlui/handle/unipi/13629 | |
| dc.identifier.uri | http://dx.doi.org/10.26267/unipi_dione/1052 | |
| dc.format.extent | 169 | el |
| dc.language.iso | en | el |
| dc.publisher | Πανεπιστήμιο Πειραιώς | el |
| dc.rights | Αναφορά Δημιουργού 3.0 Ελλάδα | * |
| dc.rights.uri | http://creativecommons.org/licenses/by/3.0/gr/ | * |
| dc.title | Distributed stream and event processing pipeline in serverless architecture | el |
| dc.type | Master Thesis | el |
| dc.contributor.department | Σχολή Τεχνολογιών Πληροφορικής και Επικοινωνιών. Τμήμα Ψηφιακών Συστημάτων | el |
| dc.description.abstractEN | The increasing interconnection of our world over the last decade has led to an exponential growth of data that are emitted from personal devices, IoT sensors and other activities of our society. As a result, a very large amount of this data is produced in the form of continuous streams. Data stream processing in real-time has become a crucial operation for several business domains, however processing a large amount of data often from different sources still represents a challenge both technologically and operationally. These needs have led to the emergence of open source and commercial systems that aim to manage and analyze data streams. These systems are of continuing importance as the constant multiplication of data stream sources increases. This dissertation presents the theoretical background on data processing and the two prevalent architectures for stream processing: The Lambda and Kappa architecture. We also present popular open-source and commercial products on the wider data streaming domain. In the second part of the dissertation, we present the design and implementation of a stream analytics pipeline built on top of Microsoft’s Azure cloud platform. We use the Twitter API to stream and analyze data as well as to execute benchmarks to examine the solution’s performance. Finally, we present the solution’s artifacts as deployable templates. | el |
| dc.contributor.master | Ψηφιακά Συστήματα και Υπηρεσίες | el |
| dc.subject.keyword | Big data | el |
| dc.subject.keyword | Cloud computing | el |
| dc.subject.keyword | Stream analytics | el |
| dc.subject.keyword | Real-time processing | el |
| dc.date.defense | 2021-06-30 |
Αρχεία σε αυτό το τεκμήριο
Αυτό το τεκμήριο εμφανίζεται στις ακόλουθες συλλογές
-
Τμήμα Ψηφιακών Συστημάτων
Department of Digital Systems
Εκτός από όπου διευκρινίζεται διαφορετικά, το τεκμήριο διανέμεται με την ακόλουθη άδεια:
Αναφορά Δημιουργού 3.0 Ελλάδα
Αναφορά Δημιουργού 3.0 Ελλάδα