Full comment
Consider ordinary 3 dimensional space: Go to a corner of the room, where the floor and two walls meet, and see three lines, each line the intersection of the two walls or a wall and the floor. In usual building architecture, these three lines are mutually perpendicular, i.e., orthogonal . Regard each of these three lines as an axis of a coordinate system. In particular, pick a point on each of the three axes to give us points with coordinates: (1,0,0) -- the X axis (0,1,0) -- the Y axis (0,0,1) -- the Z axis Soooo, now we have a standard coordinate system for ordinary 3 dimensional space. Now consider a point P in the room (in my case, the end of the pony tail of that sweet, gorgeous blond I keep looking at!) with coordinates (x,y,z) for some numbers x, y, z. For the X coordinate of point P we make use of the X axis and our point P: We take the dot ( inner ) product of (1,0,0) and (x,y,z) and get, presto, bingo, wonder of wonders, no doubt, x. Similarly for y and z. Or, for each axis, our inner product projects point P on that axis. And from those projections we can reconstruct the coordinates of point P. Beginning to sound like Fourier theory???? This stuff of projections onto orthogonal and then reconstructions from that generalizes. In Fourier theory, those sine waves are mutually perpendicular -- project one on another and get 0. That summation is the inner product for that projection. And if not a summation, then an integration -- same stuff, use an inner product to do p