Posts

Showing posts from September, 2021

Namespaces and Scopes in Python

Every entity in python is thought about an object. We offer some names to every item like variable, class, and function for identification. Often these names are known as identifiers. So, the name is nothing but the identifier. All these names and where we utilize value are stored in the main memory at a distinct location. This area is known as area. So the location designated to an item name and its value is referred to as a namespace in python. Python likewise maintains its namespace that is known as a python dictionary. All namespaces in python resemble dictionaries in which names are thought about as secrets, and dictionary worths are the real worths associated with those names. Kinds of Namespaces in Python Built-in Namespace When we run the Python interpreter without developing any user-defined function, class, or module, some functions like input(), print(), type() are constantly present. These are built-in namespaces. Worldwide Namespace When we produce a module, it creates it...

Relu activation

 What Is Activation Function The activation function is actually a simple function that converts your input or set of inputs into a specific outcome or output. There are various kinds of activation functions that do this job differently. The activation functions can be divided in 3 categories Ridge functions Radial functions Fold functions In this article we study ReLU activation function which is the example of ridge function. ReLU Activation Function ReLU represents Remedied Linear System. ReLU activation function is one of the most used activation functions in the deep learning models. ReLU function is utilized in almost all convolutional neural networks or deep learning designs. Advantages of ReLU function When the input is OKAY, no gradient saturation issue. Easy to execute and very quickly The calculation speed is very rapidly. The ReLU function has just a direct relationship. However forward or backward, much faster than tanh and sigmoid.( tanh and Sigmoid you need to compu...