-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
7 changed files
with
243 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -27,6 +27,7 @@ | |
"gdpr", | ||
"noble", | ||
"pagers", | ||
"mini-clouds", | ||
] | ||
|
||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,73 @@ | ||
{% extends "blogpost.html" %} | ||
|
||
{% block title %} | ||
<h1>Pave the way for distributed clouds on premises</h1> | ||
{% endblock %} | ||
|
||
{% block date %} | ||
<p class="blogpost__date">Published on November 07, 2024</p> | ||
{% endblock %} | ||
|
||
{% block image %} | ||
<img | ||
src="{{ url_for('static', filename='img/federation.png') }}" | ||
alt="Federation" | ||
class="blogpost__image" /> | ||
<br /> | ||
<p align="center"><small><a href="https://www.creativefabrica.com/product/beautiful-painting-of-an-elaborate-steampunk-airship-fleet-5/">Steampunk airship fleet by Greg Hildebrandt, Vladimir Kush, Gediminas Pranckevicius, Erik Johansson, and Peter Mohrbacher</a></small></p> | ||
<br /> | ||
{% endblock %} | ||
|
||
{% block article %} | ||
<h2>Current trends</h2> | ||
<p>Virtualisation solutions and moving data, computational, and software capabilities to the cloud drives for example, | ||
<a href="https://www.redhat.com/en/topics/cloud-native-apps">cloud-native</a> and | ||
<a href="https://www.redhat.com/en/topics/cloud-native-apps/what-is-serverless">serverless</a> applications. | ||
Its adoption signifies that centralisation of software and hardware resources in the hyperscale data centres allows | ||
for energy aware storage solutions like using | ||
<a href="https://www.superssd.com/kb/ssd-power-consumption/">Solid-State Drives for data needing high transfer | ||
speeds and long-term backup storage solutions for the rest of the data</a>. Data centres can also use | ||
<a href="https://green.org/2024/01/30/solar-power-for-data-centers-and-it-infrastructure/">solar and | ||
wind farms</a>, which is less likely an option for smaller organisations. Detection and shutdown of idle servers | ||
can also easily be done centrally to save energy. Most of all, the cloud enables use on demand of resources and | ||
geolocation for bringing a service near its end-points now.</p> | ||
<p>Development of Integrated infrastructures concerns dedicated sustainable hardware for software development, and | ||
includes domain specific hardware. </p> | ||
|
||
<h2>Near future</h2> | ||
<p><a href="https://www.techtarget.com/searchdatacenter/definition/edge-computing">Edge computing</a> is a distributed | ||
model that brings some computational tasks and data storage closer to the user | ||
(as source of data and as consumer). It can range from static mini-clouds on premises to flexible follow-the-need | ||
services via onboard computing and distributed networks of computational nodes. Originally developed with IoT | ||
applications in mind, mini-clouds on premises can be perceived as an intermediate step towards a completely | ||
distributed paradigm following and supporting the ongoing trend in decentralised energy production and smart | ||
energy grids. This then can allow for better profiling of energy consumption patterns and data usage patterns.</p> | ||
<p>AI computational tasks are very energy greedy. Trends such as federated learning algorithms, data compression of | ||
curated data, and approximate computing help reduce energy consumption, and perhaps there will be | ||
<a href="https://arxiv.org/pdf/2204.02766">data-centric green AI techniques</a>.</p> | ||
<p>Especially worth mentioning is | ||
<a href="https://dl.acm.org/doi/pdf/10.1145/3510455.3512776">sustainability-aware self-adaptation</a>, using | ||
decision maps.</p> | ||
<p>What all three need is further research, academic and industrial eduction, additional learning paths, and most of | ||
all, an attitude towards responsibility for sustainable solutions created by design. Designs will likely first | ||
focus on reuse and hardware lifecycle management for creating longer lasting and better maintainable hardware, at | ||
a trade-off for being able to adopt new types of hardware when they become available.</p> | ||
|
||
<h2>The far future?</h2> | ||
<p>High power usage in computing caused by the von Neumann bottleneck is a significant sustainability issue, and <a href="https://ieeexplore.ieee.org/document/10207712">Non-von Neumann architectures</a> promise solutions for sustainable and energy-efficient nodes, especially at the edge layer. </p> | ||
<p>Photonic integrated circuits have already enabled fast artificial neural networks. <a href="https://pubs.acs.org/doi/10.1021/acsphotonics.2c01543">Photonics</a> can perhaps piggy-back on distributed paradigms. </p> | ||
|
||
<h2>Problems</h2> | ||
<p>Awareness creation requires monitoring and communicating environmental impacts and a behavioural change in data | ||
consumption patterns, and is a big problem because | ||
<a href="https://digital-strategy.ec.europa.eu/en/news/accelerating-green-transition-role-digital-infrastructures-decarbonising-energy-and-mobility">there is not enough digital spine (yet)</a>. | ||
Real progress requires shared responsibility and accountability by all involved in all value chains. A very big ask. Unclear use, business, and communal cases and little activating legislation like dynamic pricing on real-time energy demands, make such changes very hard. Especially unclear are the effects on provision quality, energy savings, and the developments in the evolution of technology ecosystems, for example for federated mini-clouds on premises.</p> | ||
<p>A spine could help. These issues are complex and are thought to need to be solved on an international level first. This can take decades, if it happens at all.</p> | ||
<p>People don't like change. Really? People LOVE change, IF coming in the right proportion, at the right time and in the right way. If a proposed change is not being implemented, then the problem is with the change and not with people. </p> | ||
<p>Apparently there are not enough champions that have the decision power and budget to take the initiative and steer towards sustainability. There seems to be a perceived need for a coordinated change, sharing costs/risks and preventing compartmentalisation and silos. When using a large cloud provider, users give their power to make sustainability changes away to the provider. One just has to follow. In the context of federated mini-clouds, we can perhaps find sufficient champions in sustainability NGO's.</p> | ||
|
||
<h2>What if ...</h2> | ||
|
||
<p>What if, instead of going (only) top-down, we could also go bottom up in some small organisations, preferably with off-the-shelf open source Cloud solutions such as <a href="https://www.openstack.org/">OpenStack</a>, and work towards an on-premises cloud, and find some other like-minded organisations to share resources with to create a small distributed cloud.</p> | ||
<p>Then we can make guides, and include some of the monitoring, provision quality, and energy savings results giving similar other organisations more choices for their decisions on how to progress towards more sustainable set-ups. What if we can pave ways?</p> | ||
{% endblock %} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,143 @@ | ||
<!DOCTYPE html> | ||
<html lang="en"> | ||
<head> | ||
<!-- Required meta tags --> | ||
<meta charset="utf-8"> | ||
<meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no"> | ||
<title>Unseen University</title> | ||
|
||
<!-- Favicons --> | ||
<link rel="apple-touch-icon" sizes="180x180" href="/static/favicons/apple-touch-icon.png"> | ||
<link rel="icon" type="image/png" sizes="32x32" href="/static/favicons/favicon-32x32.png"> | ||
<link rel="icon" type="image/png" sizes="16x16" href="/static/favicons/favicon-16x16.png"> | ||
<link rel="manifest" href="/static/favicons/site.webmanifest"> | ||
<link rel="mask-icon" href="/static/favicons/safari-pinned-tab.svg" color="#333333"> | ||
<link rel="shortcut icon" href="/static/favicons/favicon.ico" type="image/x-icon"> | ||
<meta name="msapplication-TileColor" content="#333333"> | ||
<meta name="theme-color" content="#000000"> | ||
|
||
<!-- Local CSS file for styling the application--> | ||
<link rel="stylesheet" href="/static/css/base_style.css"> | ||
|
||
<!-- Additional Styling --> | ||
|
||
<link rel="stylesheet" href="/static/css/blogpost_style.css"> | ||
|
||
|
||
</head> | ||
|
||
<body> | ||
<header> | ||
<h1><a href="https://tymyrddin.dev">Ty Myrddin Home</a></h1> | ||
<nav> | ||
<ul> | ||
<li class="nav__item"><a href="/" class="nav__link">Unseen University</a></li> | ||
<li class="nav__item"><a href="/blog/" class="nav__link">Improbability Blog</a></li> | ||
<li class="nav__item"><a href="/about/" class="nav__link">About</a></li> | ||
<li class="nav__item"><a href="/registration/" class="nav__link">Register</a></li> | ||
</ul> | ||
</nav> | ||
</header> | ||
|
||
<main class="content"> | ||
<!-- child template --> | ||
|
||
<div class="blogpost-container card-overlay"> | ||
<div class="blogpost__heading"> | ||
|
||
<h1>Pave the way for distributed clouds on premises</h1> | ||
|
||
|
||
<h3>by Ty Myrddin</h3> | ||
|
||
|
||
<p class="blogpost__date">Published on November 07, 2024</p> | ||
|
||
</div> | ||
|
||
<div class="blogpost__image"> | ||
|
||
<img | ||
src="/static/img/federation.png" | ||
alt="Federation" | ||
class="blogpost__image" /> | ||
<br /> | ||
<p align="center"><small><a href="https://www.creativefabrica.com/product/beautiful-painting-of-an-elaborate-steampunk-airship-fleet-5/">Steampunk airship fleet by Greg Hildebrandt, Vladimir Kush, Gediminas Pranckevicius, Erik Johansson, and Peter Mohrbacher</a></small></p> | ||
<br /> | ||
|
||
</div> | ||
|
||
<div class="blogpost__article"> | ||
|
||
<h2>Current trends</h2> | ||
<p>Virtualisation solutions and moving data, computational, and software capabilities to the cloud drives for example, | ||
<a href="https://www.redhat.com/en/topics/cloud-native-apps">cloud-native</a> and | ||
<a href="https://www.redhat.com/en/topics/cloud-native-apps/what-is-serverless">serverless</a> applications. | ||
Its adoption signifies that centralisation of software and hardware resources in the hyperscale data centres allows | ||
for energy aware storage solutions like using | ||
<a href="https://www.superssd.com/kb/ssd-power-consumption/">Solid-State Drives for data needing high transfer | ||
speeds and long-term backup storage solutions for the rest of the data</a>. Data centres can also use | ||
<a href="https://green.org/2024/01/30/solar-power-for-data-centers-and-it-infrastructure/">solar and | ||
wind farms</a>, which is less likely an option for smaller organisations. Detection and shutdown of idle servers | ||
can also easily be done centrally to save energy. Most of all, the cloud enables use on demand of resources and | ||
geolocation for bringing a service near its end-points now.</p> | ||
<p>Development of Integrated infrastructures concerns dedicated sustainable hardware for software development, and | ||
includes domain specific hardware. </p> | ||
|
||
<h2>Near future</h2> | ||
<p><a href="https://www.techtarget.com/searchdatacenter/definition/edge-computing">Edge computing</a> is a distributed | ||
model that brings some computational tasks and data storage closer to the user | ||
(as source of data and as consumer). It can range from static mini-clouds on premises to flexible follow-the-need | ||
services via onboard computing and distributed networks of computational nodes. Originally developed with IoT | ||
applications in mind, mini-clouds on premises can be perceived as an intermediate step towards a completely | ||
distributed paradigm following and supporting the ongoing trend in decentralised energy production and smart | ||
energy grids. This then can allow for better profiling of energy consumption patterns and data usage patterns.</p> | ||
<p>AI computational tasks are very energy greedy. Trends such as federated learning algorithms, data compression of | ||
curated data, and approximate computing help reduce energy consumption, and perhaps there will be | ||
<a href="https://arxiv.org/pdf/2204.02766">data-centric green AI techniques</a>.</p> | ||
<p>Especially worth mentioning is | ||
<a href="https://dl.acm.org/doi/pdf/10.1145/3510455.3512776">sustainability-aware self-adaptation</a>, using | ||
decision maps.</p> | ||
<p>What all three need is further research, academic and industrial eduction, additional learning paths, and most of | ||
all, an attitude towards responsibility for sustainable solutions created by design. Designs will likely first | ||
focus on reuse and hardware lifecycle management for creating longer lasting and better maintainable hardware, at | ||
a trade-off for being able to adopt new types of hardware when they become available.</p> | ||
|
||
<h2>The far future?</h2> | ||
<p>High power usage in computing caused by the von Neumann bottleneck is a significant sustainability issue, and <a href="https://ieeexplore.ieee.org/document/10207712">Non-von Neumann architectures</a> promise solutions for sustainable and energy-efficient nodes, especially at the edge layer. </p> | ||
<p>Photonic integrated circuits have already enabled fast artificial neural networks. <a href="https://pubs.acs.org/doi/10.1021/acsphotonics.2c01543">Photonics</a> can perhaps piggy-back on distributed paradigms. </p> | ||
|
||
<h2>Problems</h2> | ||
<p>Awareness creation requires monitoring and communicating environmental impacts and a behavioural change in data | ||
consumption patterns, and is a big problem because | ||
<a href="https://digital-strategy.ec.europa.eu/en/news/accelerating-green-transition-role-digital-infrastructures-decarbonising-energy-and-mobility">there is not enough digital spine (yet)</a>. | ||
Real progress requires shared responsibility and accountability by all involved in all value chains. A very big ask. Unclear use, business, and communal cases and little activating legislation like dynamic pricing on real-time energy demands, make such changes very hard. Especially unclear are the effects on provision quality, energy savings, and the developments in the evolution of technology ecosystems, for example for federated mini-clouds on premises.</p> | ||
<p>A spine could help. These issues are complex and are thought to need to be solved on an international level first. This can take decades, if it happens at all.</p> | ||
<p>People don't like change. Really? People LOVE change, IF coming in the right proportion, at the right time and in the right way. If a proposed change is not being implemented, then the problem is with the change and not with people. </p> | ||
<p>Apparently there are not enough champions that have the decision power and budget to take the initiative and steer towards sustainability. There seems to be a perceived need for a coordinated change, sharing costs/risks and preventing compartmentalisation and silos. When using a large cloud provider, users give their power to make sustainability changes away to the provider. One just has to follow. In the context of federated mini-clouds, we can perhaps find sufficient champions in sustainability NGO's.</p> | ||
|
||
<h2>What if ...</h2> | ||
|
||
<p>What if, instead of going (only) top-down, we could also go bottom up in some small organisations, preferably with off-the-shelf open source Cloud solutions such as <a href="https://www.openstack.org/">OpenStack</a>, and work towards an on-premises cloud, and find some other like-minded organisations to share resources with to create a small distributed cloud.</p> | ||
<p>Then we can make guides, and include some of the monitoring, provision quality, and energy savings results giving similar other organisations more choices for their decisions on how to progress towards more sustainable set-ups. What if we can pave ways?</p> | ||
|
||
</div> | ||
|
||
<div class="blogpost__article"> | ||
<hr> | ||
<p> | ||
Raw magic crackled from their spines, earthing itself harmlessly in the copper rails nailed to every shelf for | ||
that very purpose. Faint traceries of blue fire crawled across the bookcases and there was a sound, a | ||
papery whispering, such as might come from a colony of roosting starlings. In the silence of the night the | ||
books talked to one another. <span style="float:right"> <strong>A student</strong></span></p> | ||
|
||
</div> | ||
</div> | ||
|
||
</main> | ||
|
||
<footer> | ||
<p><a href="https://www.tymyrddin.dev/">Ty Myrddin</a> - <a rel="me" href="https://mastodon.social/@barzh">Mastodon</a> - <a rel="me" href="https://tube.spdns.org/a/barzh/video-channels">Move IT tube</a> - <a rel="me" href="https://github.com/tymyrddin">GitHub</a> - <a rel="me" href="https://gitlab.com/tymyrddin">Gitlab</a> - <a rel="me" href="https://bitbucket.org/tymyrddin/workspace/repositories/">Bitbucket</a></p> | ||
</footer> | ||
</body> | ||
</html> |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.