Neural Networks and Activation Functions Previous Year Questions (PYQs) for GATE DA: 4+ Solved Questions with Step-by-Step Solutions

    Solve 4+ Neural Networks and Activation Functions previous year questions for GATE DA with answers and detailed solutions. Free sample questions below.

    Chapter Roadmap: Neural Networks and Activation Functions

    Chapter Roadmap

    Neural Networks and Activation Functions

    1. ReLU Activation Properties and Gradients (Current)

    • Definition and mechanics of the Rectified Linear Unit
    • Why it solves the vanishing gradient problem
    • The derivative and the "Dying ReLU" trap

    2. ReLU Activation Properties and Gradients (Advanced)

    • Handling the limitations of standard ReLU
    • Variants like Leaky ReLU and their gradient flows

    3. Neural Network Architecture, Parameters and Equivalence

    • Building blocks of multi-layer perceptrons
    • Exact methods for counting weights and biases

    4. Neural Network Architecture, Parameters and Equivalence (Advanced)

    • Functional equivalence between different network topologies
    • Complex architectural reasoning for exam problems

    What you will master

    By the end of this chapter, you will be able to compute gradients through activation functions, diagnose training failures, and precisely calculate the parameter count of any given feed-forward network.

    ReLU Activation Properties and Gradients

    Neural Networks > ReLU Activation

    ReLU Activation Properties and Gradients

    ReLU is the engine that made training deep neural networks computationally feasible and stable, replacing older functions like Sigmoid and Tanh.

    01 Piecewise mathematical definition
    02 Mitigating vanishing gradients
    03 Derivative and subgradient rules
    04 Identifying the "Dying ReLU" trap

    Neural Networks and Activation Functions: Solved Questions with Step-by-Step Explanations (4 Problems)

    Question 1 · Machine Learning NAT
    Consider a fully-connected feed-forward multi-layer perceptron. It has 30 neurons in the input layer, followed by two hidden layers and an output layer. The first hidden layer has 4 neurons and the second hidden layer has 3 neurons. The output layer has only one neuron. Assume that no bias parameters are used.

    The number of learnable parameters in the multi-layer perceptron is __________ . (Answer in integer)
    Question 2 · Machine Learning MCQ
    Consider the neural network shown in the figure with
    inputs:
    weights:
    output:
    denotes the ReLU function, .

    u v R R R a b c d e f y
    Given

    which one of the following is correct?
    1. A.

    2. B.

    3. C.

    4. D.

    Question 3 · Machine Learning MSQ
    1. A.

      ReLU is continuous everywhere

    2. B.

      ReLU is differentiable everywhere

    3. C.

      ReLU is not differentiable at

    4. D.

      ReLU() = ReLU(), for all

    Question 4 · Machine Learning MCQ
    Consider the two neural networks (NNs) shown in Figures 1 and 2, with
    activation (). denotes the set of real numbers. The
    connections and their corresponding weights are shown in the Figures. The biases
    at every neuron are set to 0. For what values of in Figure 2 are the two NNs
    equivalent, when
    ,
    ,
    are positive?
    Figure 1x₁x₂x₃111111222233Figure 2x₁x₂x₃pqr
    1. A.

    2. B.

    3. C.

    4. D.

    More previous year questions (pyqs) in this unit

    chapter
    Neural Networks and Activation Functions Previous Year Questions (PYQs) for GATE DA: 4+ Solved Questions with Step-by-Step Solutions

    Solve 4+ Neural Networks and Activation Functions previous year questions for GATE DA with answers and detailed solutions. Free sample questions below.

    A question from this chapter

    Question 1
    Consider a fully-connected feed-forward multi-layer perceptron. It has 30 neurons in the input layer, followed by two hidden layers and an output layer. The first hidden layer has 4 neurons and the second hidden layer has 3 neurons. The output layer has only one neuron. Assume that no bias parameters are used.

    The number of learnable parameters in the multi-layer perceptron is __________ . (Answer in integer)
    Question 2
    Consider the neural network shown in the figure with
    inputs:
    weights:
    output:
    denotes the ReLU function, .

    u v R R R a b c d e f y
    Given

    which one of the following is correct?
    Question 3
    Question 4
    Consider the two neural networks (NNs) shown in Figures 1 and 2, with
    activation (). denotes the set of real numbers. The
    connections and their corresponding weights are shown in the Figures. The biases
    at every neuron are set to 0. For what values of in Figure 2 are the two NNs
    equivalent, when
    ,
    ,
    are positive?
    Figure 1x₁x₂x₃111111222233Figure 2x₁x₂x₃pqr
    Free preview ends here

    Login to view the complete previous-year questions and solutions

    Creating an account is free. You get the rest of this chapter, step-by-step solutions, and a study plan built around the topics you are actually weak at.

    Why MastersUp

    Personalised first. High quality throughout.

    Most platforms hand everyone the same content. Here the content moves with your performance, topic by topic.

    Built around you, not around a syllabus PDF

    Every answer you give moves your topic-level intelligence rate. The next question, the next revision card and tomorrow's plan all change with it.

    Revision that hits your weak spots

    We only revise topics you have actually attempted and are still below the safe bar on — never the same chapter on repeat.

    Questions calibrated to the real exam

    Each question carries a measured toughness. You are served a rung above your current level, so practice keeps stretching you.

    Notes written for recall, not for volume

    Full lesson cards for first study, curated short-note cards for the last mile — with derivations, traps and exam patterns marked.

    One place for everything

    Notes, chapter practice, previous-year questions, test series and full-length papers — all feeding one picture of your preparation.

    Honest progress

    No vanity streaks. Progress here means chapters mastered and accuracy that held up on harder questions.

    Unlock the whole course

    Full notes and short notes, the complete question bank with worked solutions, mock tests, full-length papers, and an adaptive plan that rebuilds itself as you improve.