Create Pip Package

[abetlen]

Hey @saharNooby here is some preliminary work to set up a python package similar to the one I've set up in llama-cpp-python using scikit-build to handle building the shared library. This is still a work-in-progress so I'm totally open to change anything / answer any questions / etc. Let me know what you think

Changes

• Add scikit-build artifacts to gitignore
• Add shared library target to Makefile
• Add scikit-build specific section to CMakeLists
• Add project scaffolding files (setup.py, pyproject.toml)
• Update shared library name for macos (use Makefile instead of cmake to avoid M1 architecture issues)
• Search for shared object file in package
• I also created a package on PyPI just to test this out, if you have a username there I can add you as the project owner :)

[saharNooby]

Suggested change

	if(SKBUILD)
	if (SKBUILD)

[saharNooby]

I guess just rwkv_cpp or more preferred rwkv-cpp is fine, since this is already a Python package :)

[abetlen]

Sounds good, I'll update this as well. I believe both alias to the same name on PyPI.

[saharNooby]

Huge thanks! Sorry if it is inappropriate to leave comments on draft PR. Let me know when this is ready for me to check whether it builds!

BTW, do I need to register somewhere/do something extra to publish the package to pip?

[abetlen]

Hure thanks! Sorry if it is inappropriate to leave comments on draft PR. Let me know when this is ready for me to check whether it builds!

Not at all, thank you so much for all your work on this project, hopefully this will let more people (like me) experiment with RWKV in their projects. And yes, I'll let you know once it's ready to test, the build currently works correctly but I'm having some pure python importing issues.

BTW, do I need to register somewhere/do something extra to publish the package to pip?

Yes, just head over to https://pypi.org/account/register/ and once you've registered let me know the username.

[saharNooby]

@abetlen Registered on PyPi: https://pypi.org/user/saharNooby/

[abetlen]

@abetlen Registered on PyPi: https://pypi.org/user/saharNooby/

Awesome, invite sent.

[abetlen]

Latest changes:

• Had to rename rkwv folder to rwkv_cpp, unfortunately no way around this as python package import must have the same name as the folder they sit in and there's already an official non-cpu RWKV package so this avoids conflicts.
• Removed the nested requirements file as this is already covered by the setup.py script

[iacore]

Is this branch stable? I'm going to back-port my changes onto this.

[abetlen]

@iacore yes these are all my changes so far, really appreciate that! Sorry I meant to put more work in here but I got a little busy in the last week.