Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] ollama model provider can not set 'num_ctx' etc. parameter #2442

Closed
itaa opened this issue Feb 28, 2025 · 4 comments
Closed

[Bug] ollama model provider can not set 'num_ctx' etc. parameter #2442

itaa opened this issue Feb 28, 2025 · 4 comments
Assignees
@zyyfit
Labels
Status: Completed Type: Bug
Milestone
v1.10.2

Comments

@itaa
Copy link
Contributor

itaa commented Feb 28, 2025

Contact Information

No response

MaxKB Version

v1.10.1-lts (build at 2025-02-13T18:52, commit: 0640d4c)

Problem Description

ollama model provider can not set 'num_ctx' etc. parameter

Steps to Reproduce

Set num_ctx parameter:

Image

Error
Image

The expected correct result

Content can be returned normally.

Related log output



Additional Information


No response

      		
    

      
  





        



            

              
            

        

      


      
    








      

    



      

  
            


  


  
    
  
  

    
  itaa 

      added a commit
        to jacksoja/MaxKB
      that referenced
      this issue

    
      Feb 28, 2025
    
    

      


  

    

      


  

      
        @itaa
  





      

        
          fix bug 1Panel-dev#2442
        

          
            
          

      


      

          

    
    
    

  

      


      

      


      
      

        
          0c65c20
        
      

    

  

    

      
langchain-openai is not compatible with parameter Settings in ollama, such as num_ctx. Therefore, you need to create model instances using langchain-ollama

    




    

  




  

  

    
  


  

      

    @itaa
itaa



    mentioned this issue
    
      Feb 28, 2025
    





  


  

      
   Closed

  







  




  


  
    
  
  

    
  itaa 

      added a commit
        to jacksoja/MaxKB
      that referenced
      this issue

    
      Feb 28, 2025
    
    

      


  

    

      


  

      
        @itaa
  





      

        
          fix: ollama model provider can not set 'num_ctx' etc. parameter 1Pane…
        

          
            
          

      


      

          

    
    
    

  

      


      

      


      
      

        
          42ae7b4
        
      

    

  

    

      
…l-dev#2442

langchain-openai is not compatible with parameter Settings in ollama, such as num_ctx. Therefore, you need to create model instances using langchain-ollama

    




    

  




  


  
    
  
  

    
  itaa 

      added a commit
        to jacksoja/MaxKB
      that referenced
      this issue

    
      Feb 28, 2025
    
    

      


  

    

      


  

      
        @itaa
  





      

        
          fix: ollama model provider can not set 'num_ctx' etc. parameter 1Pane…
        

          
            
          

      


      

          

    
    
    

  

      


      

      


      
      

        
          432ca8b
        
      

    

  

    

      
…l-dev#2442

langchain-openai is not compatible with parameter Settings in ollama, such as num_ctx. Therefore, you need to create model instances using langchain-ollama

(cherry picked from commit 42ae7b4)

    




    

  




  

  

    
  


  

      

    @itaa
itaa



    mentioned this issue
    
      Feb 28, 2025
    





  


  

      
   Merged

  







  




  


  
    
  
  

    
  shaohuzhang1 

      pushed a commit
      that referenced
      this issue

    
      Feb 28, 2025
    
    

      


  

    

      


  

      
        @itaa
  





      

        
          fix: ollama model provider can not set 'num_ctx' etc. parameter #2442 (…
        

          
            
          

      


      

          

    
    
    

  

    


      


      

          

    
    
    

  

  

    
  



      


      
      

        
          ed8f8f8
        
      

    

  

    

      
…#2444)

langchain-openai is not compatible with parameter Settings in ollama, such as num_ctx. Therefore, you need to create model instances using langchain-ollama

(cherry picked from commit 42ae7b4)

    




    

  




    

    

      
    

    


      

          @maninhill
maninhill




          added this to the   v1.10.2 milestone


      Feb 28, 2025

    

  



    







      

  
      



  

  @Shenguobin0102





  


    

      

  

    

        
    
    

  


      
          
  
      
            Copy link

  

      
    

  


  

      



      

  


  

    

  





      


        


  
    

      
          
感谢反馈，下个版本会支持这个参数设置。

      		
    

  





        


            

            

              
            

        

      


      

            
  

    
  
    
    

  

  



    












      

  
      



  

  @shaohuzhang1





  


    

      

  

    

        
    
    

  


      
          
  
      
            Copy link

  

      
    

  


  

      

  
    Contributor


      

  


  

    

  





      


        


  
    

      
          


Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿






Thanks for the feedback, this parameter setting will be supported in the next version.

      		
    

  





        


            

            

              
            

        

      


      

            
  

    
  
    
    

  

  



    












      

  
            







      

  
      



  

  @baixin513





  


    

      

  

    

        
    
    

  


      
          
  
      
            Copy link

  

      
    

  


  

      

  
    Contributor


      

  


  

    

  





      


        


  
    

      
          
v1.10.2-lts已发布。

      		
    

  





        


            

            

              
            

        

      


      

            
  

    
  
    
    

  

  



    












      

  
            

    







      

  
      



  

  @shaohuzhang1





  


    

      

  

    

        
    
    

  


      
          
  
      
            Copy link

  

      
    

  


  

      

  
    Contributor


      

  


  

    

  





      


        


  
    

      
          


Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿






v1.10.2-lts has been released.

      		
    

  





        


            

            

              
            

        

      


      

            
  

    
  
    
    

  

  



    
















  
  

    

      

  





  




  
  

              

  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment


  



  






  
                  




    

  


      
  

    Assignees
  



        

      

        

  
      @zyyfit
  
    zyyfit
    

      








      


  


  

    Labels
  



    

      

    Status: Completed

  

    Type: Bug









      

  

    

        

    Projects
  


        




    None yet




  



      


  

    
  

    Milestone
  


      
    
  
    v1.10.2
  





    
      
          


  

    

      
        

          
    

    Development
  




            
    
No branches or pull requests







      
    

  




      

    

  
      

  

    

      6 participants
    

    

        
          @itaa 
        
          @maninhill 
        
          @baixin513 
        
          @zyyfit 
        
          @shaohuzhang1 
        
          @Shenguobin0102