Tutorial: tensor network basics

[EmilianoG-byte]

Before submitting

Please complete the following checklist when submitting a PR:

• Ensure that your tutorial executes correctly, and conforms to the
  guidelines specified in the README.

• Remember to do a grammar check of the content you include.

• All tutorials conform to
  PEP8 standards.
  To auto format files, simply pip install black, and then
  run black -l 100 path/to/file.py.

When all the above are checked, delete everything above the dashed
line and fill in the pull request template.

---

Title:

Summary:

Relevant references:

[sc-66746]

---

If you are writing a demonstration, please answer these questions to facilitate the marketing process.

• GOALS — Why are we working on this now?

  Eg. Promote a new PL feature or show a PL implementation of a recent paper.

• AUDIENCE — Who is this for?

  Eg. Chemistry researchers, PL educators, beginners in quantum computing.

• KEYWORDS — What words should be included in the marketing post?

• Which of the following types of documentation is most similar to your file?
  (more details here)

• Tutorial
• Demo
• How-to

[github-actions]

👋 Hey, looks like you've updated some demos!

🐘 Don't forget to update the dateOfLastModification in the associated metadata files so your changes are reflected in Glass Onion (search and recommendations).

Please hide this comment once the field(s) are updated. Thanks!

[Qottmann]

Great skeleton @EmilianoG-byte @Shiro-Raven !

Mainly minor suggestions, and one bigger one towards the last section for quantum circuit applications

[github-actions]

Thank you for opening this pull request.

You can find the built site at this link.

Deployment Info:

• Pull Request ID: 1193
• Deployment SHA: 8609239d6627121b6c36968d789d46bd8dd5f14f
  (The Deployment SHA refers to the latest commit hash the docs were built from)

Note: It may take several minutes for updates to this pull request to be reflected on the deployed site.

[EmilianoG-byte]

Initial draft from last week:

DRAFT:

• Definition of a tensor as an n-dimensional array. Show notation with n indices, stating that it belongs to C^{d1,...,dn}. Define rank, index, dimension (mention how these terms are sometimes used (wrongly?) interchangeably in literature).
• Graphical notation. Mention that there exist certain representations in the literature that allow to represent properties of the tensors (e.g. symmetry, orthogonality). In our case, we can adhere to a general circle.
• Specific examples used in a day-to-day: scalars, vectors, matrices. Mention that for quantum states, we can adopt the convention that the legs in one direction mean that the state belongs to one Hilbert space, and the legs to the other side to the dual space.
• CODE: include code using numpy creating a >2 dimensional array.

• Show the matrix multiplication in terms of summation over indices, then using the diagrammatic representation. This results in another rank 2 tensor (matrix)
• Analagously, we can represent matrix-vector multiplication resulting in a rank 1 tensor (vector). Just as we expected!
• We can generalize this concept to tensors. This is done by summing over repeated indices (just as in einstein convention - external link for it) resulting in another tensor made up of the open legs of all the tensors together.
  In diagrammatic notation, this is simply sticking together legs with same indices! (show nice diagram with >3 tensors). We have just formed a network of tensors, i.e. a Tensor Network!
• CODE: Talking about einstein convetion, we can perform this contraction of tensors using np.einsum.

• Mention that the resulting tensor network doesn't change but the way we arrive to the final tensor affects how expensive it is to get there.
• Show how can we can calculate the complexity of a contraction by means of a simple example using 2 matrices (rank 2 tensors): dimension_contracted x (dimensions_open).
• Intuition behind: we perform one operation (contraction) and repeat many times to "populate" the resulting tensor (dimension_open1 x dimension_open2). Show the equation with indices.
• Show an example with at least three tensors where they all have different dimensions. Walk through it showing that choosing to contract two indices (the ones with lower dimensions) results in a worst computational complexity than contracting other ones (the ones with higher dimensions).

Very nice source with visual explanations that we can cite: https://www.math3ma.com/blog/matrices-as-tensor-network-diagrams

[EmilianoG-byte]

Hi @Qottmann ! I have finished checking the spelling and grammar so I believe the demo is now ready for a review :).

If anything, I saw my last 3 drawings could use some improvement in the thickness of the lines, but I guess that’s a minor detail I can correct in the following days :D

[Qottmann]

@EmilianoG-byte awesome :) you can expect a review at the latest by eow

[Qottmann]

Great first draft @EmilianoG-byte , congrats!

I left a bunch of nitpicky comments, in particular feel free to ignore those marked as "personal opinion" at your discretion.

The demo starts relatively slow in the beginning (which is great pedagogically) and then very quickly goes very fast (also understandable since that is in the nature of these highly complex topics).

I wonder if you can adjust the pace on either ends to make the experience smoother (I understand this is a very vague and hard-to-implement suggestion, but perhaps you get an idea). Perhaps it is also more a matter of the framing of the scope of the demo, making it clear in the beginning, end and thoughout what this demo is trying to achieve.

Perhaps as a good exercise for you to answer first and then use to translate into the draft: who is the target audience of this demo? what is the intention of writing this demo? and what should a reader take away from it?

I think the content itself it already great, it is just a matter of framing and scoping of the text :)

[Qottmann]

(personal opinion)
could be reduced or even removed

[EmilianoG-byte]

Should I make the changes you were referring about being more clear about the scope of the demo?

[EmilianoG-byte]

I have added some transition sentences (and even an intermezzo :o), let me know what you think @Qottmann !

[Qottmann]

I quite like the idea of the intermezzo :) from reading that the context is clear. do you think there is also a way you could specify in the intro which parts of the contents are going to be "the first part"? Because technically this currently consists of 3 sub-parts, perhaps you can introduce main headings "part1" and "part 2", with the current headings (minus intermezzo) being sub-headings.

In particular, this structure

1. Part 1
1.1 from matrices to tensors
1.2 from matrix multiplication to tensor contractions
1.2.1 CNOT gate
1.3 cost of contraction
2. Intermezzo
3. Part 2
...

(note that I dont mean that the headings in the content actually have this numbering, this is just to explain the logic)

[Qottmann]

what is the meaning of dimension here? I'd either name the meaning of "dimension" directly here or leave the comment alltogether as it doesnt help at this stage

[EmilianoG-byte]

I have cleaned a bit the explanation on the index-dimension relation. Strictly speaking, I also think is not truly necessary, but perhaps could be helpful for beginners that can get confused with the terminology when coming from other tutorials :)

[Qottmann]

Is the differentiation between bra and kets via the direction they are pointing a common definition and actually necessary here? Instead of ascribing duals to left-pointing legs, you can also just indicate complex conjugation of $v$ as the concept of transposition becomes irrelevant in tensor diagrams (leaving only complex conjugation)

[EmilianoG-byte]

I would say for "general tensor networks" (like in condensed matter) this is the opposite convention. But since in quantum computing we read from left to right, you can see that all kets result in legs pointing right. Analogously the bra $\langle v|$ is a tensor with legs pointing left. Again, this is probably just the convention that arisis in quantum circuit circuit diagrams and is not a general convention. I am not sure i understand the second part of your comment 🤔

[Qottmann]

when writing tensor diagrams, transposition becomes irrelevant as it is always clear from context. So the only thing you need to differentiate a bra from a ket is complex conjugation, which you can indicate with a star or bar over the tensor name :)

[EmilianoG-byte]

I think I know what you refer to, but I don't think those statements agree with these definitions:

from https://arxiv.org/pdf/1912.10049. When thinking of the applications I have encountered in condensed matter I have the impressions that your statements make sense. But in other applications, representation the transposition of a tensor by bending its wires has been quite fundamental (in my experience).

[Qottmann]

I personally have never seen these definitions and conventions outside of this particular review by Biamonte. There is nothing wrong with it, I was just wondering if it's adding something to your demo or making things unnecessarily comlicated (as in, are you making good use of this in the demo? Or can the demo do without it? I dont think it's widespread and therefore necessary to share as common knowledge). I'm sharing this observation and in the end it is up to you as the author to decide :)

[ikurecic]

Please swap this out like this:

Suggested change

	"id": "emiliano_godinez"
	},
	{
	"id": "ahmed_darwish"
	"username": "emiliano"
	},
	{
	"username": "ShiroRaven"

It will pass the metadata checks then.

Also, @Shiro-Raven , you're still missing a picture and the Headline on your account.

[Qottmann]

is @Shiro-Raven still an author of the demo?

[Shiro-Raven]

Hey there! Very sorry for the radio silence. Emiliano and I actually agreed a long time ago that he will go on and have complete authorship of this demo, so please remove me from the metadata and the authors section

[ikurecic]

tk