Skip to content

Commit

Permalink
Added Mini-clouds
Browse files Browse the repository at this point in the history
  • Loading branch information
ninabarzh committed Nov 8, 2024
1 parent d7cf7e6 commit e76a4a1
Show file tree
Hide file tree
Showing 7 changed files with 243 additions and 0 deletions.
1 change: 1 addition & 0 deletions project/blog/routes.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@
"gdpr",
"noble",
"pagers",
"mini-clouds",
]


Expand Down
13 changes: 13 additions & 0 deletions project/blog/templates/blog/blog.html
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,19 @@
{% block content %}
<div class="blog-container">

<div class="blog-post-card card-overlay">
<img
src="{{ url_for('static', filename='img/federation.png') }}"
alt="Federation"
class="blog-post-card__image" />
<div class="blog-post-card__body">
<a href="{{ url_for('blog.posts', blog_title='mini-clouds') }}">
<h2 class="recipe-title-long">Pave the way for distributed clouds on premises</h2></a>
<p>People LOVE change, IF coming in the right proportion, at the right time and in the right way. Why don't we start small and produce guides for others to join ...</p>
<p class="blog-post-card__date">Published on Nov 07, 2024</p>
</div>
</div>

<div class="blog-post-card card-overlay">
<img
src="{{ url_for('static', filename='img/exploding-pagers.png') }}"
Expand Down
73 changes: 73 additions & 0 deletions project/blog/templates/blog/mini-clouds.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,73 @@
{% extends "blogpost.html" %}

{% block title %}
<h1>Pave the way for distributed clouds on premises</h1>
{% endblock %}

{% block date %}
<p class="blogpost__date">Published on November 07, 2024</p>
{% endblock %}

{% block image %}
<img
src="{{ url_for('static', filename='img/federation.png') }}"
alt="Federation"
class="blogpost__image" />
<br />
<p align="center"><small><a href="https://www.creativefabrica.com/product/beautiful-painting-of-an-elaborate-steampunk-airship-fleet-5/">Steampunk airship fleet by Greg Hildebrandt, Vladimir Kush, Gediminas Pranckevicius, Erik Johansson, and Peter Mohrbacher</a></small></p>
<br />
{% endblock %}

{% block article %}
<h2>Current trends</h2>
<p>Virtualisation solutions and moving data, computational, and software capabilities to the cloud drives for example,
<a href="https://www.redhat.com/en/topics/cloud-native-apps">cloud-native</a> and
<a href="https://www.redhat.com/en/topics/cloud-native-apps/what-is-serverless">serverless</a> applications.
Its adoption signifies that centralisation of software and hardware resources in the hyperscale data centres allows
for energy aware storage solutions like using
<a href="https://www.superssd.com/kb/ssd-power-consumption/">Solid-State Drives for data needing high transfer
speeds and long-term backup storage solutions for the rest of the data</a>. Data centres can also use
<a href="https://green.org/2024/01/30/solar-power-for-data-centers-and-it-infrastructure/">solar and
wind farms</a>, which is less likely an option for smaller organisations. Detection and shutdown of idle servers
can also easily be done centrally to save energy. Most of all, the cloud enables use on demand of resources and
geolocation for bringing a service near its end-points now.</p>
<p>Development of Integrated infrastructures concerns dedicated sustainable hardware for software development, and
includes domain specific hardware. </p>

<h2>Near future</h2>
<p><a href="https://www.techtarget.com/searchdatacenter/definition/edge-computing">Edge computing</a> is a distributed
model that brings some computational tasks and data storage closer to the user
(as source of data and as consumer). It can range from static mini-clouds on premises to flexible follow-the-need
services via onboard computing and distributed networks of computational nodes. Originally developed with IoT
applications in mind, mini-clouds on premises can be perceived as an intermediate step towards a completely
distributed paradigm following and supporting the ongoing trend in decentralised energy production and smart
energy grids. This then can allow for better profiling of energy consumption patterns and data usage patterns.</p>
<p>AI computational tasks are very energy greedy. Trends such as federated learning algorithms, data compression of
curated data, and approximate computing help reduce energy consumption, and perhaps there will be
<a href="https://arxiv.org/pdf/2204.02766">data-centric green AI techniques</a>.</p>
<p>Especially worth mentioning is
<a href="https://dl.acm.org/doi/pdf/10.1145/3510455.3512776">sustainability-aware self-adaptation</a>, using
decision maps.</p>
<p>What all three need is further research, academic and industrial eduction, additional learning paths, and most of
all, an attitude towards responsibility for sustainable solutions created by design. Designs will likely first
focus on reuse and hardware lifecycle management for creating longer lasting and better maintainable hardware, at
a trade-off for being able to adopt new types of hardware when they become available.</p>

<h2>The far future?</h2>
<p>High power usage in computing caused by the von Neumann bottleneck is a significant sustainability issue, and <a href="https://ieeexplore.ieee.org/document/10207712">Non-von Neumann architectures</a> promise solutions for sustainable and energy-efficient nodes, especially at the edge layer. </p>
<p>Photonic integrated circuits have already enabled fast artificial neural networks. <a href="https://pubs.acs.org/doi/10.1021/acsphotonics.2c01543">Photonics</a> can perhaps piggy-back on distributed paradigms. </p>

<h2>Problems</h2>
<p>Awareness creation requires monitoring and communicating environmental impacts and a behavioural change in data
consumption patterns, and is a big problem because
<a href="https://digital-strategy.ec.europa.eu/en/news/accelerating-green-transition-role-digital-infrastructures-decarbonising-energy-and-mobility">there is not enough digital spine (yet)</a>.
Real progress requires shared responsibility and accountability by all involved in all value chains. A very big ask. Unclear use, business, and communal cases and little activating legislation like dynamic pricing on real-time energy demands, make such changes very hard. Especially unclear are the effects on provision quality, energy savings, and the developments in the evolution of technology ecosystems, for example for federated mini-clouds on premises.</p>
<p>A spine could help. These issues are complex and are thought to need to be solved on an international level first. This can take decades, if it happens at all.</p>
<p>People don't like change. Really? People LOVE change, IF coming in the right proportion, at the right time and in the right way. If a proposed change is not being implemented, then the problem is with the change and not with people. </p>
<p>Apparently there are not enough champions that have the decision power and budget to take the initiative and steer towards sustainability. There seems to be a perceived need for a coordinated change, sharing costs/risks and preventing compartmentalisation and silos. When using a large cloud provider, users give their power to make sustainability changes away to the provider. One just has to follow. In the context of federated mini-clouds, we can perhaps find sufficient champions in sustainability NGO's.</p>

<h2>What if ...</h2>

<p>What if, instead of going (only) top-down, we could also go bottom up in some small organisations, preferably with off-the-shelf open source Cloud solutions such as <a href="https://www.openstack.org/">OpenStack</a>, and work towards an on-premises cloud, and find some other like-minded organisations to share resources with to create a small distributed cloud.</p>
<p>Then we can make guides, and include some of the monitoring, provision quality, and energy savings results giving similar other organisations more choices for their decisions on how to progress towards more sustainable set-ups. What if we can pave ways?</p>
{% endblock %}
13 changes: 13 additions & 0 deletions project/build/blog/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,19 @@ <h1><a href="https://tymyrddin.dev">Ty Myrddin Home</a></h1>

<div class="blog-container">

<div class="blog-post-card card-overlay">
<img
src="/static/img/federation.png"
alt="Federation"
class="blog-post-card__image" />
<div class="blog-post-card__body">
<a href="/mini-clouds/">
<h2 class="recipe-title-long">Pave the way for distributed clouds on premises</h2></a>
<p>People LOVE change, IF coming in the right proportion, at the right time and in the right way. Why don't we start small and produce guides for others to join ...</p>
<p class="blog-post-card__date">Published on Nov 07, 2024</p>
</div>
</div>

<div class="blog-post-card card-overlay">
<img
src="/static/img/exploding-pagers.png"
Expand Down
143 changes: 143 additions & 0 deletions project/build/mini-clouds/index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,143 @@
<!DOCTYPE html>
<html lang="en">
<head>
<!-- Required meta tags -->
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no">
<title>Unseen University</title>

<!-- Favicons -->
<link rel="apple-touch-icon" sizes="180x180" href="/static/favicons/apple-touch-icon.png">
<link rel="icon" type="image/png" sizes="32x32" href="/static/favicons/favicon-32x32.png">
<link rel="icon" type="image/png" sizes="16x16" href="/static/favicons/favicon-16x16.png">
<link rel="manifest" href="/static/favicons/site.webmanifest">
<link rel="mask-icon" href="/static/favicons/safari-pinned-tab.svg" color="#333333">
<link rel="shortcut icon" href="/static/favicons/favicon.ico" type="image/x-icon">
<meta name="msapplication-TileColor" content="#333333">
<meta name="theme-color" content="#000000">

<!-- Local CSS file for styling the application-->
<link rel="stylesheet" href="/static/css/base_style.css">

<!-- Additional Styling -->

<link rel="stylesheet" href="/static/css/blogpost_style.css">


</head>

<body>
<header>
<h1><a href="https://tymyrddin.dev">Ty Myrddin Home</a></h1>
<nav>
<ul>
<li class="nav__item"><a href="/" class="nav__link">Unseen University</a></li>
<li class="nav__item"><a href="/blog/" class="nav__link">Improbability Blog</a></li>
<li class="nav__item"><a href="/about/" class="nav__link">About</a></li>
<li class="nav__item"><a href="/registration/" class="nav__link">Register</a></li>
</ul>
</nav>
</header>

<main class="content">
<!-- child template -->

<div class="blogpost-container card-overlay">
<div class="blogpost__heading">

<h1>Pave the way for distributed clouds on premises</h1>


<h3>by Ty Myrddin</h3>


<p class="blogpost__date">Published on November 07, 2024</p>

</div>

<div class="blogpost__image">

<img
src="/static/img/federation.png"
alt="Federation"
class="blogpost__image" />
<br />
<p align="center"><small><a href="https://www.creativefabrica.com/product/beautiful-painting-of-an-elaborate-steampunk-airship-fleet-5/">Steampunk airship fleet by Greg Hildebrandt, Vladimir Kush, Gediminas Pranckevicius, Erik Johansson, and Peter Mohrbacher</a></small></p>
<br />

</div>

<div class="blogpost__article">

<h2>Current trends</h2>
<p>Virtualisation solutions and moving data, computational, and software capabilities to the cloud drives for example,
<a href="https://www.redhat.com/en/topics/cloud-native-apps">cloud-native</a> and
<a href="https://www.redhat.com/en/topics/cloud-native-apps/what-is-serverless">serverless</a> applications.
Its adoption signifies that centralisation of software and hardware resources in the hyperscale data centres allows
for energy aware storage solutions like using
<a href="https://www.superssd.com/kb/ssd-power-consumption/">Solid-State Drives for data needing high transfer
speeds and long-term backup storage solutions for the rest of the data</a>. Data centres can also use
<a href="https://green.org/2024/01/30/solar-power-for-data-centers-and-it-infrastructure/">solar and
wind farms</a>, which is less likely an option for smaller organisations. Detection and shutdown of idle servers
can also easily be done centrally to save energy. Most of all, the cloud enables use on demand of resources and
geolocation for bringing a service near its end-points now.</p>
<p>Development of Integrated infrastructures concerns dedicated sustainable hardware for software development, and
includes domain specific hardware. </p>

<h2>Near future</h2>
<p><a href="https://www.techtarget.com/searchdatacenter/definition/edge-computing">Edge computing</a> is a distributed
model that brings some computational tasks and data storage closer to the user
(as source of data and as consumer). It can range from static mini-clouds on premises to flexible follow-the-need
services via onboard computing and distributed networks of computational nodes. Originally developed with IoT
applications in mind, mini-clouds on premises can be perceived as an intermediate step towards a completely
distributed paradigm following and supporting the ongoing trend in decentralised energy production and smart
energy grids. This then can allow for better profiling of energy consumption patterns and data usage patterns.</p>
<p>AI computational tasks are very energy greedy. Trends such as federated learning algorithms, data compression of
curated data, and approximate computing help reduce energy consumption, and perhaps there will be
<a href="https://arxiv.org/pdf/2204.02766">data-centric green AI techniques</a>.</p>
<p>Especially worth mentioning is
<a href="https://dl.acm.org/doi/pdf/10.1145/3510455.3512776">sustainability-aware self-adaptation</a>, using
decision maps.</p>
<p>What all three need is further research, academic and industrial eduction, additional learning paths, and most of
all, an attitude towards responsibility for sustainable solutions created by design. Designs will likely first
focus on reuse and hardware lifecycle management for creating longer lasting and better maintainable hardware, at
a trade-off for being able to adopt new types of hardware when they become available.</p>

<h2>The far future?</h2>
<p>High power usage in computing caused by the von Neumann bottleneck is a significant sustainability issue, and <a href="https://ieeexplore.ieee.org/document/10207712">Non-von Neumann architectures</a> promise solutions for sustainable and energy-efficient nodes, especially at the edge layer. </p>
<p>Photonic integrated circuits have already enabled fast artificial neural networks. <a href="https://pubs.acs.org/doi/10.1021/acsphotonics.2c01543">Photonics</a> can perhaps piggy-back on distributed paradigms. </p>

<h2>Problems</h2>
<p>Awareness creation requires monitoring and communicating environmental impacts and a behavioural change in data
consumption patterns, and is a big problem because
<a href="https://digital-strategy.ec.europa.eu/en/news/accelerating-green-transition-role-digital-infrastructures-decarbonising-energy-and-mobility">there is not enough digital spine (yet)</a>.
Real progress requires shared responsibility and accountability by all involved in all value chains. A very big ask. Unclear use, business, and communal cases and little activating legislation like dynamic pricing on real-time energy demands, make such changes very hard. Especially unclear are the effects on provision quality, energy savings, and the developments in the evolution of technology ecosystems, for example for federated mini-clouds on premises.</p>
<p>A spine could help. These issues are complex and are thought to need to be solved on an international level first. This can take decades, if it happens at all.</p>
<p>People don't like change. Really? People LOVE change, IF coming in the right proportion, at the right time and in the right way. If a proposed change is not being implemented, then the problem is with the change and not with people. </p>
<p>Apparently there are not enough champions that have the decision power and budget to take the initiative and steer towards sustainability. There seems to be a perceived need for a coordinated change, sharing costs/risks and preventing compartmentalisation and silos. When using a large cloud provider, users give their power to make sustainability changes away to the provider. One just has to follow. In the context of federated mini-clouds, we can perhaps find sufficient champions in sustainability NGO's.</p>

<h2>What if ...</h2>

<p>What if, instead of going (only) top-down, we could also go bottom up in some small organisations, preferably with off-the-shelf open source Cloud solutions such as <a href="https://www.openstack.org/">OpenStack</a>, and work towards an on-premises cloud, and find some other like-minded organisations to share resources with to create a small distributed cloud.</p>
<p>Then we can make guides, and include some of the monitoring, provision quality, and energy savings results giving similar other organisations more choices for their decisions on how to progress towards more sustainable set-ups. What if we can pave ways?</p>

</div>

<div class="blogpost__article">
<hr>
<p>
Raw magic crackled from their spines, earthing itself harmlessly in the copper rails nailed to every shelf for
that very purpose. Faint traceries of blue fire crawled across the bookcases and there was a sound, a
papery whispering, such as might come from a colony of roosting starlings. In the silence of the night the
books talked to one another. <span style="float:right"> <strong>A student</strong></span></p>

</div>
</div>

</main>

<footer>
<p><a href="https://www.tymyrddin.dev/">Ty Myrddin</a> - <a rel="me" href="https://mastodon.social/@barzh">Mastodon</a> - <a rel="me" href="https://tube.spdns.org/a/barzh/video-channels">Move IT tube</a> - <a rel="me" href="https://github.com/tymyrddin">GitHub</a> - <a rel="me" href="https://gitlab.com/tymyrddin">Gitlab</a> - <a rel="me" href="https://bitbucket.org/tymyrddin/workspace/repositories/">Bitbucket</a></p>
</footer>
</body>
</html>
Binary file added project/build/static/img/federation.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added project/static/img/federation.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit e76a4a1

Please sign in to comment.