/.idea/
/.settings/
/target/
-/doc/apidocs/
+/Documentation/apidocs/
/*.iml
/test.byar
*.html
--- /dev/null
+#+SETUPFILE: ~/.emacs.d/org-styles/html/darksun.theme
+#+TITLE: Aukio Data - Data storage and computing engine
+#+LANGUAGE: en
+#+LATEX_HEADER: \usepackage[margin=1.0in]{geometry}
+#+LATEX_HEADER: \usepackage{parskip}
+#+LATEX_HEADER: \usepackage[none]{hyphenat}
+
+#+OPTIONS: H:20 num:20
+#+OPTIONS: author:nil
+
+* General
+:PROPERTIES:
+:CUSTOM_ID: general
+:END:
+
+- This program is free software: released under Creative Commons Zero
+ (CC0) license
+
+- Program author:
+ - Svjatoslav Agejenko
+ - Homepage: https://svjatoslav.eu
+ - Email: mailto://svjatoslav@svjatoslav.eu
+
+- [[https://www.svjatoslav.eu/projects/][Other software projects hosted at svjatoslav.eu]]
+
+** Source code
+:PROPERTIES:
+:CUSTOM_ID: source-code
+:END:
+- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=snapshot;h=HEAD;sf=tgz][Download latest snapshot in TAR GZ format]]
+
+- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=summary][Browse Git repository online]]
+
+- Clone Git repository using command:
+ : git clone https://www2.svjatoslav.eu/git/aukio-data.git
+
+- See [[https://www3.svjatoslav.eu/projects/aukio-data/apidocs/][JavaDoc]].
+
+* Vision / goal
+ :PROPERTIES:
+ :CUSTOM_ID: vision-goal
+ :ID: f6764282-a6f6-44e6-8716-b428074dd093
+ :END:
+
+Provide hackable, versioned, optimized, distributed, geometrical,
+arbitrary dimensional hypercube based data storage and computation
+engine ([[id:d2375acc-af14-4f18-8ad0-7949501178c5][as inspired by the brain]]) for general purpose visual computing
+environment called [[http://www2.svjatoslav.eu/gitbrowse/aukio/doc/index.html][Aukio]].
+
+
+* Ideas / inspiration
+:PROPERTIES:
+:CUSTOM_ID: ideas
+:END:
+
++ [[https://en.wikipedia.org/wiki/OLAP_cube][OLAP cube]].
+
+** Brain
+ :PROPERTIES:
+ :CUSTOM_ID: brain
+ :ID: d2375acc-af14-4f18-8ad0-7949501178c5
+ :END:
+
++ Brain appears to be natural geometrical/parallel data storage and
+ computational engine:
+ + https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/
+ + [[https://www.simonsfoundation.org/2021/04/07/geometrical-thinking-offers-a-window-into-computation/][Geometrical Thinking Offers a Window Into Computation]]
+
++ Even more awesome is that brain appears to operate and is wired as
+ arbitrary/variable dimensional structure:
+ https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/
+
++ On top of this, this multidimensional space that brain represents
+ has dynamic/variable resolution/density:
+ + https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328
+
++ Such properties allow parallel Geometrical computation and
+ beautifully fits CM-1 Connection Machine architecture (for extra
+ hardware accelerated solution).
+
+** CM-1 Connection Machine
+:PROPERTIES:
+:CUSTOM_ID: cm-1-connection-machine
+:ID: 01aa65c1-3d44-44a8-9b90-58454bc6be80
+:END:
+
+https://en.wikipedia.org/wiki/Connection_Machine
+
+Massively parallel (thousands of CPUs) connected via
+machine's internal 12-dimensional hypercube network allows to
+efficiently simulate arbitrary dimensional hypercube and network
+topology between computational units. So that when we are
+solving/simulating for example 5 dimensional problem, we can arrange
+computational units into virtual 5D network. See:
+http://www.mission-base.com/tamiko/theory/cm_txts/di-ch2.html
+
+we can pre-distribute data across computation units and perform
+parallel geometrical computation.
+
+
+** Integrate with lossless diamond square algorithm based multidimensional data compressor
+:PROPERTIES:
+:CUSTOM_ID: integrate-lossless-diamond-square-compressor
+:END:
+
++ Demonstrate using 3D UI for debugging algorithm internals.
+
++ Separate RGB/YUV channels into separate encoders/decoders
+
++ Make demo lossless image and sound CODECS.
+
+** Distributed computation and data storage
+ :PROPERTIES:
+ :CUSTOM_ID: distributed-computation-and-data-storage
+ :ID: 5d287158-53ea-44a2-a754-dd862366066a
+ :END:
+
+Lots of problems can be translated to geometry (use any shapes and as
+many dimensions as you need). Solution(s) to such problems could be
+then found via geometrical search/comparison/lookup results. As a
+bonus, such geometrical *data storage* AND *computation* can be
+naturally made in *parallel* and *distributed*.
+
+** The "Datacube" is a Fundamental Data Structure
+
+The world is not just Sets (SQL), Hierarchies (XML/JSON), or Graphs
+(SPARQL). *Arrays* are the fourth pillar. Treating them as "just
+another file format" or "a blob in a table" is a fundamental error
+that leads to performance collapse.
+
+* Current status
+:PROPERTIES:
+:CUSTOM_ID: current-status
+:END:
+
+- More or less defined [[id:f6764282-a6f6-44e6-8716-b428074dd093][Vision / goal]].
+
+- Collected some inspiring ideas.
+
+- Implemented very simple persistent key-value map.
+ - Long term goal is to use it as a backing storage engine and
+ implement more advanced features on top of this via layered
+ architecture.
}
export_org_files_to_html() {
- echo "🔍 Searching for .org files in doc/ ..."
+ echo "🔍 Searching for .org files in Documentation/ ..."
echo "======================================="
- mapfile -t ORG_FILES < <(find doc -type f -name "*.org" | sort)
+ mapfile -t ORG_FILES < <(find Documentation -type f -name "*.org" | sort)
if [ ${#ORG_FILES[@]} -eq 0 ]; then
echo "❌ No .org files found!"
export_org_files_to_html
echo "📤 Uploading to server..."
-rsync -avz --delete -e 'ssh -p 10006' doc/ \
+rsync -avz --delete -e 'ssh -p 10006' Documentation/ \
n0@www3.svjatoslav.eu:/mnt/big/projects/aukio-data/
if [ $? -eq 0 ]; then
+++ /dev/null
-#+SETUPFILE: ~/.emacs.d/org-styles/html/darksun.theme
-#+TITLE: Aukio Data - Data storage and computing engine
-#+LANGUAGE: en
-#+LATEX_HEADER: \usepackage[margin=1.0in]{geometry}
-#+LATEX_HEADER: \usepackage{parskip}
-#+LATEX_HEADER: \usepackage[none]{hyphenat}
-
-#+OPTIONS: H:20 num:20
-#+OPTIONS: author:nil
-
-* General
-:PROPERTIES:
-:CUSTOM_ID: general
-:END:
-
-- This program is free software: released under Creative Commons Zero
- (CC0) license
-
-- Program author:
- - Svjatoslav Agejenko
- - Homepage: https://svjatoslav.eu
- - Email: mailto://svjatoslav@svjatoslav.eu
-
-- [[https://www.svjatoslav.eu/projects/][Other software projects hosted at svjatoslav.eu]]
-
-** Source code
-:PROPERTIES:
-:CUSTOM_ID: source-code
-:END:
-- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=snapshot;h=HEAD;sf=tgz][Download latest snapshot in TAR GZ format]]
-
-- [[https://www2.svjatoslav.eu/gitweb/?p=aukio-data.git;a=summary][Browse Git repository online]]
-
-- Clone Git repository using command:
- : git clone https://www2.svjatoslav.eu/git/aukio-data.git
-
-- See [[https://www3.svjatoslav.eu/projects/aukio-data/apidocs/][JavaDoc]].
-
-* Vision / goal
- :PROPERTIES:
- :CUSTOM_ID: vision-goal
- :ID: f6764282-a6f6-44e6-8716-b428074dd093
- :END:
-
-Provide hackable, versioned, optimized, distributed, geometrical,
-arbitrary dimensional ([[id:96116550-a6a1-4700-bef7-865d0deee7ea][hypercube based]]) data storage and computation
-engine ([[id:d2375acc-af14-4f18-8ad0-7949501178c5][as inspired by the brain]]) for general purpose visual computing
-environment called [[http://www2.svjatoslav.eu/gitbrowse/aukio/doc/index.html][Aukio]].
-
-
-* Ideas / inspiration
-:PROPERTIES:
-:CUSTOM_ID: ideas
-:END:
-
-+ [[https://en.wikipedia.org/wiki/OLAP_cube][OLAP cube]].
-
-** Brain
- :PROPERTIES:
- :CUSTOM_ID: brain
- :ID: d2375acc-af14-4f18-8ad0-7949501178c5
- :END:
-
-+ Brain appears to be natural geometrical/parallel data storage and
- computational engine:
- + https://www.quantamagazine.org/the-brain-maps-out-ideas-and-memories-like-spaces-20190114/
- + [[https://www.simonsfoundation.org/2021/04/07/geometrical-thinking-offers-a-window-into-computation/][Geometrical Thinking Offers a Window Into Computation]]
-
-+ Even more awesome is that brain appears to operate and is wired as
- arbitrary/variable dimensional structure:
- https://singularityhub.com/2017/06/21/is-there-a-multidimensional-mathematical-world-hidden-in-the-brains-computation/
-
-+ On top of this, this multidimensional space that brain represents
- has dynamic/variable resolution/density:
- + https://www.quantamagazine.org/goals-and-rewards-redraw-the-brains-map-of-the-world-20190328
-
-+ Such properties allow parallel Geometrical computation and
- beautifully fits CM-1 Connection Machine architecture (for extra
- hardware accelerated solution).
-
-** CM-1 Connection Machine
-:PROPERTIES:
-:CUSTOM_ID: cm-1-connection-machine
-:ID: 01aa65c1-3d44-44a8-9b90-58454bc6be80
-:END:
-
-https://en.wikipedia.org/wiki/Connection_Machine
-
-Massively parallel (thousands of CPUs) connected via
-machine's internal 12-dimensional hypercube network allows to
-efficiently simulate arbitrary dimensional hypercube and network
-topology between computational units. So that when we are
-solving/simulating for example 5 dimensional problem, we can arrange
-computational units into virtual 5D network. See:
-http://www.mission-base.com/tamiko/theory/cm_txts/di-ch2.html
-
-we can pre-distribute data across computation units and perform
-parallel [[id:171fe375-c737-41e6-b429-a414f6abc5d8][geometrical computation]].
-
-
-** Integrate with lossless diamond square algorithm based multidimensional data compressor
-:PROPERTIES:
-:CUSTOM_ID: integrate-lossless-diamond-square-compressor
-:END:
-
-+ Demonstrate using 3D UI for debugging algorithm internals.
-
-+ Separate RGB/YUV channels into separate encoders/decoders
-
-+ Make demo lossless image and sound CODECS.
-
-** Distributed computation and data storage
- :PROPERTIES:
- :CUSTOM_ID: distributed-computation-and-data-storage
- :ID: 5d287158-53ea-44a2-a754-dd862366066a
- :END:
-
-Lots of problems can be translated to geometry (use any shapes and as
-many dimensions as you need). Solution(s) to such problems could be
-then found via geometrical search/comparison/lookup results. As a
-bonus, such geometrical *data storage* AND *computation* can be
-naturally made in *parallel* and *distributed*.
-
-** The "Datacube" is a Fundamental Data Structure
-
-The world is not just Sets (SQL), Hierarchies (XML/JSON), or Graphs
-(SPARQL). *Arrays* are the fourth pillar. Treating them as "just
-another file format" or "a blob in a table" is a fundamental error
-that leads to performance collapse.
-
-* Current status
-:PROPERTIES:
-:CUSTOM_ID: current-status
-:END:
-
-- More or less defined [[id:f6764282-a6f6-44e6-8716-b428074dd093][Vision / goal]].
-
-- Collected some [[id:0fa6354b-18c9-4120-bbf5-c7239aebecab][inspiring]] [[id:171fe375-c737-41e6-b429-a414f6abc5d8][ideas]].
-
-- Implemented very simple persistent key-value map.
- - Long term goal is to use it as a backing storage engine and
- implement more advanced features on top of this via layered
- architecture.
<modelVersion>4.0.0</modelVersion>
<groupId>eu.svjatoslav</groupId>
<artifactId>aukio-data</artifactId>
- <version>1.0-SNAPSHOT</version>
+ <version>1.0.0-SNAPSHOT</version>
<name>Aukio data</name>
<description>Aukio data</description>
</repositories>
<scm>
- <connection>scm:git:ssh://n0@svjatoslav.eu/home/git/repositories/aukio-data.git</connection>
- <developerConnection>scm:git:ssh://n0@svjatoslav.eu/home/git/repositories/aukio-data.git
- </developerConnection>
+ <connection>scm:git:ssh://n0@svjatoslav.eu:10006/home/n0/git/aukio-data.git</connection>
+ <developerConnection>scm:git:ssh://n0@svjatoslav.eu:10006/home/n0/git/aukio-data.git</developerConnection>
+ <tag>HEAD</tag>
</scm>
+
</project>
projects / aukio-data.git / commitdiff