Preskoči na glavno vsebino

Bipropagation demo in TensorFlow



Bipropagation is a new Deep Learning algorithm. It is much faster and much more reliable than Backpropagation. Here is the demo from the  ResearchGate and GitHub. Inner layers of the Neural Network have not hidden anymore. Learning is done layer by layer with much fewer iterations. Please cite me in your work.


Click the G+ button if you like this demo. Any comments are desirable.

Komentarji

Priljubljene objave iz tega spletnega dnevnika

Artificial intelligence

          Artificial intelligence (AI) is a relatively young branch of science that stirs the imagination of many. Even movie directors from hollywood are not exceptions. Development in AI area is very fast and there is no indication that this will change soon. I still remember my first contact with learning devices. This happend at the end of the last millennium when I realized neural networks (NN). They have immediately attracted my attention, because such devices were not known till then.           NN are made along the lines of mammalian brain. During the learning NN extract the essence from the data. After the learning we can ask NN questions. It gives us the right answers even to questions that during learning did not participate.  NN learns autonomously and therefore may exceed the teacher's (poeple's) knowledge. Here are some important achievements of artificial intelligence: A couple of years ago the co...

Umetna inteligenca

Umetna inteligenca (UI) je razmeroma mlada veja znanosti, ki mnogim buri domišljijo. Tudi Hollywoodski režiserji niso izjema, saj skorajda ni več znanstveno-fantastičnega filma brez pametnih naprav. Razvoj na  področju UI je zelo hiter in nič ne kaže, da se bo to kmalu spremenilo.  Dobro se še spominjam svojega prvega srečanja z napravami, ki imajo sposobnost učenja. Bilo je to konec minulega tisočletja, ko sem se seznanil z nevronskimi mrežami (NM) V hipu so pritegnile mojo pozornost navkljub dejstvu, da inteligentne naprave takrat še niso bile splošno znane in so le redki verjeli v njihovo svetlo prihodnost. NM  so narejene po vzoru možganov kakršne imamo ljudje in živali. Med samostojnim učenjem so sposobne iz kopice učnih podatkov izluščiti bistvo, zato  lahko uspešno odgovarjajo tudi na vprašanja, ki jih med učenjem niso srečale. Lahko presežejo znanje svojega  učitelja ali tudi celotnega  človeštva.  Omenimo nekatere pomembne dosežke ...

Beyond Backpropagation

Gartner is predicting a very bright near future for the "Machine learning". 2015 was a peak year of inflated expectations, now, in 2016 is following period of disillusionment and in 2017 should be reached the plateau of productivity. Elsewhere this process usually last for 10 years. One kind of the most popular modern "machine learning" is named "Deep Learning" what is another name for neural networks with little bit more layers and perhaps even with a convolution and/or recursion. The learning of this kinds networks was until now usually based on gradient descent, on slow, iterative, non-reliable process named Backpropagation . That kind of learning is very demanding and extensive. On plain computer can last for hours or even many days and is often unsuccessful concluded. Recently are appeared two algorithms that significantly improve this kind of machine learning: " Bipropagation " and " Border pairs method ". Bipropagat...