Pistrie

Pistrie

`Scholar.Linear.LogisticRegression.predict(model, test_X)` returns only zeroes

Here is the relevant livebook snippet:

annotated livebook snippet
train_test_split = fn data_X, data_y, train_size ->
  {train_X, test_X} = Nx.split(data_X, train_size, axis: 0)
  {train_y, test_y} = Nx.split(data_y, train_size, axis: 0)

  {train_X, test_X, train_y, test_y}
end
#Function<40.3316493/3 in :erl_eval.expr/6>
matrix_X = Nx.stack(df_X, axis: 1)
matrix_y = Nx.stack(df_y) |> Nx.flatten()

{train_X, test_X, train_y, test_y} = train_test_split.(matrix_X, matrix_y, 0.7) |> dbg()

model = LogisticRegression.fit(train_X, train_y, num_classes: 2)
predictions = LogisticRegression.predict(model, test_X)
|> IO.inspect(limit: :infinity)

The train test split output:

{#Nx.Tensor<
   f64[500][7]
   EXLA.Backend<host:0, 0.3224788307.3268018198.174312>
   [
     [22.0, 7.25, 1.0, 0.0, 1.0, 0.0, 0.0],
     [38.0, 71.2833, 0.0, 1.0, 0.0, 1.0, 0.0],
     [26.0, 7.925, 0.0, 1.0, 1.0, 0.0, 0.0],
     [35.0, 53.1, 0.0, 1.0, 0.0, 1.0, 0.0],
     [35.0, 8.05, 1.0, 0.0, 1.0, 0.0, 0.0],
     [54.0, 51.8625, 1.0, 0.0, 0.0, 1.0, 0.0],
     [2.0, 21.075, 1.0, 0.0, 1.0, 0.0, 0.0],
     ...
   ]
 >,
 #Nx.Tensor<
   f64[214][7]
   EXLA.Backend<host:0, 0.3224788307.3268018198.174313>
   [
     [32.0, 30.5, 1.0, 0.0, 0.0, 1.0, 0.0],
     [9.0, 27.9, 0.0, 1.0, 1.0, 0.0, 0.0],
     [28.0, 13.0, 0.0, 1.0, 0.0, 0.0, 1.0],
     [32.0, 7.925, 1.0, 0.0, 1.0, 0.0, 0.0],
     [31.0, 26.25, 1.0, 0.0, 0.0, 0.0, 1.0],
     [41.0, 39.6875, 0.0, 1.0, 1.0, 0.0, 0.0],
     [20.0, 7.8542, 1.0, 0.0, 1.0, 0.0, ...],
     ...
   ]
 >,
 #Nx.Tensor<
   s64[500]
   EXLA.Backend<host:0, 0.3224788307.3268018198.174314>
   [0, 1, 1, 1, 0, 0, 0, 1, 1, 1, 1, 0, 0, 0, 1, 0, 0, 0, 1, 1, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1, 1, 0, 0, 0, 1, 1, 0, 1, 0, 1, 0, 0, 1, ...]
 >,
 #Nx.Tensor<
   s64[214]
   EXLA.Backend<host:0, 0.3224788307.3268018198.174315>
   [1, 0, 1, 0, 0, 0, 0, 1, 0, 1, 1, 0, 1, 1, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 1, 0, 0, 1, 0, 1, 1, 0, 0, 0, 0, 0, 0, 0, ...]
 >}

The IO.inspect() output:

#Nx.Tensor<
  s64[214]
  EXLA.Backend<host:0, 0.3224788307.3268018198.174324>
  [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]
>
#Nx.Tensor<
  s64[214]
  EXLA.Backend<host:0, 0.3224788307.3268018198.174324>
  [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...]
>

I’m pretty sure I did it correctly. Can someone spot a mistake of mine, or is this a problem with Scholar? Thanks :slight_smile:

First Post!

krstopro

krstopro

Hi @Pistrie! I am not able to reproduce your result as I don’t have df_X and df_Y. Could you maybe share those? Also, it is a good idea to set a random key in Nx.split/2 to keep the results reproducible.

Where Next?

Popular in Questions Top

skosch
To my knowledge, put_in, Map.update etc. all have the one limitation of not automatically creating intermediate keys when needed (for exa...
New
Patoshizzle
After calling mix ecto.create I get this error: 17:00:32.162 [error] GenServer #PID&lt;0.412.0&gt; terminating ** (Postgrex.Error) FATAL...
New
ycv005
I have followed this StackOverflow post to install the specific version of Erlang. And When I am running mix ecto.setup then getting fol...
New
baxterw3b
Hi guys, i’m new in the Elixir world, and i have to say, that i love it! i’m having some problem to understand anonymous functions with ...
New
SoCreat
i’m a new one to elixir which editor can i use vs code? or atom? Thanks! :smiley:
New
aalberti333
As the title describes, I’m trying to run Enum.map() over a list of key/value pairs, where the value is a map. My data looks like this: ...
New
RisingFromAshes
I’ve read in another post that it may be possible with a router helper - but I couldn’t find an appropriate one, and tbh, I’m still just ...
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
WestKeys
Currently suffering from paralysis by [HTTP client] analysis. This is rather unusual in Elixirland as there tends to be consensus on the ...
New
yawaramin
In the Dialyzer docs ( dialyzer — OTP 29.0.2 (dialyzer 6.0.1) ), there is a way to turn off a specific warning for a function: -dialyzer...
New

Other popular topics Top

danschultzer
None of the current solutions worked well for me, so I went ahead and built a user management system from scratch. This project took far...
548 29377 241
New
Darmani72
If I have a post route which an argument: post /my_post_route/:my_param1, MyController.my_post_handler How would get the post params ...
New
TunkShif
This post is an instruction guide to help you setup your Neovim for Elixir development from scratch. It includes general information on h...
274 41539 114
New
albydarned
Hello all! I am typing this post from my new MacBook Pro with the M1 chip. I’m loving it so far, and will probably use it as my daily dr...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
aesmail
Hello guys, I have finally made it. I created an admin interface for a framework. It’s been on my todo list for years and with the curre...
New
gausby
I asked this very same question on twitter and got some interesting feedback, but I thought it would be a good question to ask here as we...
1207 39297 209
New
Qqwy
Original source of discussion: This topic on the Pragmatic Programmers’ Functional Web Development with Elixir, OTP, and Phoenix forum. ...
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
dogweather
I wrote this comment on r/haskell, and it’s not popular there. :wink: But I think I’m on to something… Haskell reminds me of Java, and e...
New

We're in Beta

About us Mission Statement