Preskoči na glavno vsebino

Objave

Prikaz objav, dodanih na 2016

Video: Two Deep Learning algorithms

Online web session (second half of  video, after 32 minutes of intro) Two Deep Learning algorithms beyond Backpropagation
ABSTRACT In this video conference, two new algorithms for learning Feed-Forward Artificial Neural Network are presented. In the introduction, a brief description of the development of the existing algorithms and their flaws are shown. The second part describes the first new algorithm - Bipropagation. The basic idea is given first, followed by a detailed description of the algorithm. In the third part yet another new algorithm is given, called Border Pairs Method. Again is first given a basic idea and then follows a detailed description of the algorithm. In the fourth part, the results and findings of experimental work are presented. In the conclusion, it is found that two described algorithms are fast and reliable - the second one is also constructive. SPEAKER  Bojan PLOJ, PhD
Born    1965 in Maribor, Slovenia, Europe
Thesis   Border Pairs Method for learning of neur…

Bipropagation demo in TensorFlow

Bipropagation is a new Deep Learning algorithm. It is much faster and much more reliable than Backpropagation. Here is the demo from the  ResearchGate and GitHub. Inner layers of the Neural Network have not hidden anymore. Learning is done layer by layer with much fewer iterations. Please cite me in your work.


Click the G+button if you like this demo. Any comments are desirable.

Beyond Backpropagation

Gartner is predicting a very bright near future for the "Machine learning". 2015 was a peak year of inflated expectations, now, in 2016 is following period of disillusionment and in 2017 should be reached the plateau of productivity. Elsewhere this process usually last for 10 years. One kind of the most popular modern "machine learning" is named "Deep Learning" what is another name for neural networks with little bit more layers and perhaps even with a convolution and/or recursion. The learning of this kinds networks was until now usually based on gradient descent, on slow, iterative, non-reliable process named Backpropagation. That kind of learning is very demanding and extensive. On plain computer can last for hours or even many days and is often unsuccessful concluded. Recently are appeared two algorithms that significantly improve this kind of machine learning: "Bipropagation" and "Border pairs method".


Bipropagation algorithm is st…

Zgodovinski trenutek za umetno inteligenco

Trenutno globoko učenje (Deep learning) in z njim celotna umetna inteligenca doživlja razcvet, saj je v preteklem letu bilo doseženih nekaj pomembnih in odmevnih rezultatov kot so prepoznavanje fotografij in govora, prevajanje govorjenega besedila, pisanje besedila na osnovi podanih ključnih besed,... Danes, 12. 3. 2016 pa je bil tej zbirki uspehov dodan še en. Googlova globoka nevronska mreža (Deep neural Network) poimenovana AlphaGo je premagala v igri Go najboljšega igralca na svetu, Leeja Sedola.




V tej azijski miselni igri nasprotnika izmenjaje polagata črne in bele kamne na mrežo velikosti 19 krat 19. Nasprotnikovi kamni, ki so obdani z vseh 4 strani se odstranijo iz igralnega polja, cilj igre pa je zavzeti čim večji del tega polja.
Rezultat zgodovinskega dvoboja med človekom in strojem je bil 3 proti 0 v korist stroja. Poraženec Lee je po dvoboju izjavil, da je pozitivno presenečen nad zmogljivostjo umetne inteligence. Ta dogodek ima še toliko večjo težo za razvoj umetne inteli…

Bionika, zanimiv poklic prihodnosti

Živimo v času, ko se znanje ustvarja in širi vedno hitreje in temu trendu se pridružujemo tudi izobraževalne ustanove. Ponudba smeri in stopenj izobraževalnih programov se vsako leto povečuje in med novimi programi prevladujejo interdisciplinarni. To ustreza manjšim podjetjem, ki so bolj prožna in odzivna in se zato lahko bolje znajdejo v tem gospodarsko razburkanem času. V malih podjetjih namreč ni prostora za množico ozko usmerjenih strokovnjakov, v prednosti so kadri z interdisciplinarno širino, ki jo omogočata mehatronika in predvsem bionika.






     Na višji strokovni šoli na Ptuju smo že pred časom zaznali piš tega novega vetra in začeli prikrojevati naša jadra. Prvi korak v to smer je bil program Mehatronika, ki smo ga razvili pred približno desetletjem in povezuje med seboj več tehniških strok. Predvsem so to elektrotehnika, računalništvo in strojništvo. Trg delovne sile je potrdil našo vizijo saj se naši diplomanti uspešno zaposlujejo tako v Sloveniji, kakor tudi v tujini. Dodat…

Bipropagation demonstration in MatLAB

Here is given an example of the "bipropagation" algorithm for learning of NN. It is written in MatLAB language (R2015a) and is as similar as possible  to  "Deep learning" example "AutoencoderDigitsExample.m" which is included in MatLAB's Neural Network Toolbox. So you can easily compare both algorithms. I believe that my algorithm have few advantages over autoencoder. Please tell me what do you think about it. Please cite me in your works. Thanks a lot.

Download demo

======================================================
%% Training a Deep Neural Network for Digit Classification
% This example shows how to use the Neural Network Toolbox(TM) to train a
% deep neural network to classify images of digits and is very similar to
% "AutoencoderDigitsExample.m" which is included in
% Neuronal Network ToolBox from MatLAB. This example is made for comparison
% of both algorithms.
%
% Neural networks with multiple hidden layers can be useful for solving
% class…